[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260204 08:57:18.507454 15375 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.3.254:32945
I20260204 08:57:18.508963 15375 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260204 08:57:18.509974 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:57:18.525640 15382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:18.525681 15381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:18.526731 15384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:18.527175 15375 server_base.cc:1060] running on GCE node
I20260204 08:57:19.620676 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:57:19.620932 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:57:19.621122 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195439621099 us; error 0 us; skew 500 ppm
I20260204 08:57:19.621925 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:57:19.627013 15375 webserver.cc:492] Webserver started at http://127.15.3.254:38197/ using document root <none> and password file <none>
I20260204 08:57:19.627912 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:57:19.628124 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:57:19.628553 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:57:19.634332 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/master-0-root/instance:
uuid: "9b068373f4d24fb6806ac88ac1f975ed"
format_stamp: "Formatted at 2026-02-04 08:57:19 on dist-test-slave-3tf0"
I20260204 08:57:19.642280 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260204 08:57:19.647408 15390 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:19.648541 15375 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260204 08:57:19.648891 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/master-0-root
uuid: "9b068373f4d24fb6806ac88ac1f975ed"
format_stamp: "Formatted at 2026-02-04 08:57:19 on dist-test-slave-3tf0"
I20260204 08:57:19.649219 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:57:19.698546 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:57:19.700174 15375 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260204 08:57:19.700601 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:57:19.783337 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.254:32945
I20260204 08:57:19.783390 15441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.254:32945 every 8 connection(s)
I20260204 08:57:19.792054 15442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:19.814904 15442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed: Bootstrap starting.
I20260204 08:57:19.821228 15442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:19.823092 15442 log.cc:826] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed: Log is configured to *not* fsync() on all Append() calls
I20260204 08:57:19.828186 15442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed: No bootstrap required, opened a new log
I20260204 08:57:19.849671 15442 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b068373f4d24fb6806ac88ac1f975ed" member_type: VOTER }
I20260204 08:57:19.850237 15442 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:19.850490 15442 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b068373f4d24fb6806ac88ac1f975ed, State: Initialized, Role: FOLLOWER
I20260204 08:57:19.851280 15442 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b068373f4d24fb6806ac88ac1f975ed" member_type: VOTER }
I20260204 08:57:19.851796 15442 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 08:57:19.852061 15442 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 08:57:19.852387 15442 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:19.856895 15442 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b068373f4d24fb6806ac88ac1f975ed" member_type: VOTER }
I20260204 08:57:19.857631 15442 leader_election.cc:304] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b068373f4d24fb6806ac88ac1f975ed; no voters:
I20260204 08:57:19.859220 15442 leader_election.cc:290] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 08:57:19.860174 15445 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:19.862721 15445 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 1 LEADER]: Becoming Leader. State: Replica: 9b068373f4d24fb6806ac88ac1f975ed, State: Running, Role: LEADER
I20260204 08:57:19.863543 15445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b068373f4d24fb6806ac88ac1f975ed" member_type: VOTER }
I20260204 08:57:19.865127 15442 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [sys.catalog]: configured and running, proceeding with master startup.
I20260204 08:57:19.875587 15447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b068373f4d24fb6806ac88ac1f975ed. Latest consensus state: current_term: 1 leader_uuid: "9b068373f4d24fb6806ac88ac1f975ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b068373f4d24fb6806ac88ac1f975ed" member_type: VOTER } }
I20260204 08:57:19.875471 15446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b068373f4d24fb6806ac88ac1f975ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b068373f4d24fb6806ac88ac1f975ed" member_type: VOTER } }
I20260204 08:57:19.876314 15446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [sys.catalog]: This master's current role is: LEADER
I20260204 08:57:19.876308 15447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [sys.catalog]: This master's current role is: LEADER
I20260204 08:57:19.880052 15454 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 08:57:19.892211 15454 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 08:57:19.894604 15375 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 08:57:19.911512 15454 catalog_manager.cc:1357] Generated new cluster ID: 761f53d3ad5d44e1adc2de5774d28853
I20260204 08:57:19.911806 15454 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 08:57:19.931926 15454 catalog_manager.cc:1380] Generated new certificate authority record
I20260204 08:57:19.933424 15454 catalog_manager.cc:1514] Loading token signing keys...
I20260204 08:57:19.949602 15454 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed: Generated new TSK 0
I20260204 08:57:19.950500 15454 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 08:57:19.961508 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:57:19.970633 15464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:19.972573 15465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:19.976337 15375 server_base.cc:1060] running on GCE node
W20260204 08:57:19.976495 15467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:19.977460 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:57:19.977738 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:57:19.977946 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195439977928 us; error 0 us; skew 500 ppm
I20260204 08:57:19.978742 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:57:19.982667 15375 webserver.cc:492] Webserver started at http://127.15.3.193:46209/ using document root <none> and password file <none>
I20260204 08:57:19.983356 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:57:19.983608 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:57:19.983963 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:57:19.985450 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-0-root/instance:
uuid: "46223e80af8440d1be13a306ea3b2639"
format_stamp: "Formatted at 2026-02-04 08:57:19 on dist-test-slave-3tf0"
I20260204 08:57:19.992312 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260204 08:57:19.997865 15472 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:19.998701 15375 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260204 08:57:19.999066 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-0-root
uuid: "46223e80af8440d1be13a306ea3b2639"
format_stamp: "Formatted at 2026-02-04 08:57:19 on dist-test-slave-3tf0"
I20260204 08:57:19.999451 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:57:20.019001 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:57:20.021284 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:57:20.024061 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:57:20.029407 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:57:20.029734 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:20.030035 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:57:20.030257 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:20.129916 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.193:45819
I20260204 08:57:20.129959 15534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.193:45819 every 8 connection(s)
I20260204 08:57:20.137928 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:57:20.155746 15539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:20.158360 15540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:20.169827 15375 server_base.cc:1060] running on GCE node
W20260204 08:57:20.170729 15542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:20.171916 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:57:20.172194 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:57:20.172418 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195440172399 us; error 0 us; skew 500 ppm
I20260204 08:57:20.173187 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:57:20.176867 15535 heartbeater.cc:344] Connected to a master server at 127.15.3.254:32945
I20260204 08:57:20.177342 15535 heartbeater.cc:461] Registering TS with master...
I20260204 08:57:20.177651 15375 webserver.cc:492] Webserver started at http://127.15.3.194:41085/ using document root <none> and password file <none>
I20260204 08:57:20.178319 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:57:20.178390 15535 heartbeater.cc:507] Master 127.15.3.254:32945 requested a full tablet report, sending...
I20260204 08:57:20.178612 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:57:20.178972 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:57:20.180450 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-1-root/instance:
uuid: "198cabb5672e440cb5d217975122fda1"
format_stamp: "Formatted at 2026-02-04 08:57:20 on dist-test-slave-3tf0"
I20260204 08:57:20.181391 15407 ts_manager.cc:194] Registered new tserver with Master: 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819)
I20260204 08:57:20.183637 15407 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59290
I20260204 08:57:20.187816 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260204 08:57:20.193255 15547 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:20.194455 15375 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260204 08:57:20.194797 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-1-root
uuid: "198cabb5672e440cb5d217975122fda1"
format_stamp: "Formatted at 2026-02-04 08:57:20 on dist-test-slave-3tf0"
I20260204 08:57:20.195148 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:57:20.225189 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:57:20.226827 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:57:20.229744 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:57:20.233381 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:57:20.233683 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:20.233959 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:57:20.234155 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:20.333911 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.194:40285
I20260204 08:57:20.333982 15609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.194:40285 every 8 connection(s)
I20260204 08:57:20.345731 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:57:20.353936 15613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:20.358098 15610 heartbeater.cc:344] Connected to a master server at 127.15.3.254:32945
I20260204 08:57:20.359037 15610 heartbeater.cc:461] Registering TS with master...
W20260204 08:57:20.359056 15614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:20.360296 15610 heartbeater.cc:507] Master 127.15.3.254:32945 requested a full tablet report, sending...
I20260204 08:57:20.362512 15407 ts_manager.cc:194] Registered new tserver with Master: 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:20.364230 15407 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59292
W20260204 08:57:20.370947 15616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:20.371726 15375 server_base.cc:1060] running on GCE node
I20260204 08:57:20.372586 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:57:20.372782 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:57:20.372937 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195440372922 us; error 0 us; skew 500 ppm
I20260204 08:57:20.373415 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:57:20.375882 15375 webserver.cc:492] Webserver started at http://127.15.3.195:45909/ using document root <none> and password file <none>
I20260204 08:57:20.376336 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:57:20.376518 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:57:20.376767 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:57:20.378005 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-2-root/instance:
uuid: "875a583efe7b4643b2bdbd5c673f23e6"
format_stamp: "Formatted at 2026-02-04 08:57:20 on dist-test-slave-3tf0"
I20260204 08:57:20.382613 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260204 08:57:20.386610 15621 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:20.387400 15375 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260204 08:57:20.387710 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-2-root
uuid: "875a583efe7b4643b2bdbd5c673f23e6"
format_stamp: "Formatted at 2026-02-04 08:57:20 on dist-test-slave-3tf0"
I20260204 08:57:20.387979 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770195438343508-15375-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:57:20.403203 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:57:20.404424 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:57:20.405838 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:57:20.416514 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:57:20.416744 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:20.417002 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:57:20.417158 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:20.518548 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.195:41451
I20260204 08:57:20.519040 15683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.195:41451 every 8 connection(s)
I20260204 08:57:20.536118 15684 heartbeater.cc:344] Connected to a master server at 127.15.3.254:32945
I20260204 08:57:20.536473 15684 heartbeater.cc:461] Registering TS with master...
I20260204 08:57:20.537202 15684 heartbeater.cc:507] Master 127.15.3.254:32945 requested a full tablet report, sending...
I20260204 08:57:20.539016 15407 ts_manager.cc:194] Registered new tserver with Master: 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:20.539163 15375 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015697761s
I20260204 08:57:20.540747 15407 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59300
I20260204 08:57:20.589154 15407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59316:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260204 08:57:20.593300 15407 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260204 08:57:20.699689 15574 tablet_service.cc:1505] Processing CreateTablet for tablet 79b13b0d03e24d8e8e6c9c9e33e21cd4 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260204 08:57:20.701118 15575 tablet_service.cc:1505] Processing CreateTablet for tablet 60596298fe3c4d35b5398a77166c6fe9 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260204 08:57:20.702908 15573 tablet_service.cc:1505] Processing CreateTablet for tablet d0fdf8822b3642169bf1c1a0b31578c3 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260204 08:57:20.702647 15574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b13b0d03e24d8e8e6c9c9e33e21cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.706730 15573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0fdf8822b3642169bf1c1a0b31578c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.707563 15572 tablet_service.cc:1505] Processing CreateTablet for tablet a09733b3313d45d98b3ca0cb99a4a568 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260204 08:57:20.709389 15575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60596298fe3c4d35b5398a77166c6fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.710482 15572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09733b3313d45d98b3ca0cb99a4a568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.714200 15571 tablet_service.cc:1505] Processing CreateTablet for tablet 036dfe47af3b414bb6ea037b9e52a065 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260204 08:57:20.719924 15571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036dfe47af3b414bb6ea037b9e52a065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.745612 15500 tablet_service.cc:1505] Processing CreateTablet for tablet 60596298fe3c4d35b5398a77166c6fe9 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260204 08:57:20.754776 15499 tablet_service.cc:1505] Processing CreateTablet for tablet 79b13b0d03e24d8e8e6c9c9e33e21cd4 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260204 08:57:20.753961 15498 tablet_service.cc:1505] Processing CreateTablet for tablet d0fdf8822b3642169bf1c1a0b31578c3 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260204 08:57:20.749536 15497 tablet_service.cc:1505] Processing CreateTablet for tablet a09733b3313d45d98b3ca0cb99a4a568 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260204 08:57:20.759085 15499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b13b0d03e24d8e8e6c9c9e33e21cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.755448 15495 tablet_service.cc:1505] Processing CreateTablet for tablet a42896f90c0f4bf7883620541ebe16bf (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260204 08:57:20.759814 15496 tablet_service.cc:1505] Processing CreateTablet for tablet 036dfe47af3b414bb6ea037b9e52a065 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260204 08:57:20.756254 15570 tablet_service.cc:1505] Processing CreateTablet for tablet a42896f90c0f4bf7883620541ebe16bf (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260204 08:57:20.763021 15570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42896f90c0f4bf7883620541ebe16bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.767341 15498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0fdf8822b3642169bf1c1a0b31578c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.767956 15494 tablet_service.cc:1505] Processing CreateTablet for tablet c6687ad2d1ce4b8f9cbac10251985977 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260204 08:57:20.776398 15569 tablet_service.cc:1505] Processing CreateTablet for tablet c6687ad2d1ce4b8f9cbac10251985977 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260204 08:57:20.780169 15569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6687ad2d1ce4b8f9cbac10251985977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.777971 15496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036dfe47af3b414bb6ea037b9e52a065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.792721 15495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42896f90c0f4bf7883620541ebe16bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.793215 15493 tablet_service.cc:1505] Processing CreateTablet for tablet 6a26bd0dc6e64ad9b945e8f1adf29a3a (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260204 08:57:20.800110 15493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a26bd0dc6e64ad9b945e8f1adf29a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.805896 15568 tablet_service.cc:1505] Processing CreateTablet for tablet 6a26bd0dc6e64ad9b945e8f1adf29a3a (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260204 08:57:20.807164 15568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a26bd0dc6e64ad9b945e8f1adf29a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.803916 15500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60596298fe3c4d35b5398a77166c6fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.813825 15649 tablet_service.cc:1505] Processing CreateTablet for tablet 60596298fe3c4d35b5398a77166c6fe9 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260204 08:57:20.813854 15497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09733b3313d45d98b3ca0cb99a4a568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.821683 15494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6687ad2d1ce4b8f9cbac10251985977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.828886 15649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60596298fe3c4d35b5398a77166c6fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.832700 15644 tablet_service.cc:1505] Processing CreateTablet for tablet a42896f90c0f4bf7883620541ebe16bf (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260204 08:57:20.838846 15645 tablet_service.cc:1505] Processing CreateTablet for tablet 036dfe47af3b414bb6ea037b9e52a065 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260204 08:57:20.848083 15643 tablet_service.cc:1505] Processing CreateTablet for tablet c6687ad2d1ce4b8f9cbac10251985977 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260204 08:57:20.835928 15647 tablet_service.cc:1505] Processing CreateTablet for tablet d0fdf8822b3642169bf1c1a0b31578c3 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260204 08:57:20.835402 15648 tablet_service.cc:1505] Processing CreateTablet for tablet 79b13b0d03e24d8e8e6c9c9e33e21cd4 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260204 08:57:20.862094 15646 tablet_service.cc:1505] Processing CreateTablet for tablet a09733b3313d45d98b3ca0cb99a4a568 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260204 08:57:20.864041 15492 tablet_service.cc:1505] Processing CreateTablet for tablet 85047792e5da4a3f973d187e09cfb631 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260204 08:57:20.854378 15572 tablet_service.cc:1505] Processing CreateTablet for tablet 85047792e5da4a3f973d187e09cfb631 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260204 08:57:20.879874 15492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85047792e5da4a3f973d187e09cfb631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.856244 15642 tablet_service.cc:1505] Processing CreateTablet for tablet 6a26bd0dc6e64ad9b945e8f1adf29a3a (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260204 08:57:20.884159 15572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85047792e5da4a3f973d187e09cfb631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.883975 15641 tablet_service.cc:1505] Processing CreateTablet for tablet 85047792e5da4a3f973d187e09cfb631 (DEFAULT_TABLE table=test-workload [id=d72cb01f3e9940f59b7ab1e9b3e53294]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260204 08:57:20.883318 15702 tablet_bootstrap.cc:492] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:20.890210 15644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42896f90c0f4bf7883620541ebe16bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.892014 15647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0fdf8822b3642169bf1c1a0b31578c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.894043 15641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85047792e5da4a3f973d187e09cfb631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.894977 15646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a09733b3313d45d98b3ca0cb99a4a568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.896908 15648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b13b0d03e24d8e8e6c9c9e33e21cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.903937 15645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036dfe47af3b414bb6ea037b9e52a065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.914616 15643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6687ad2d1ce4b8f9cbac10251985977. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:57:20.915786 15455 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:57:20.924502 15642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a26bd0dc6e64ad9b945e8f1adf29a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:20.998027 15702 tablet_bootstrap.cc:654] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.052752 15702 tablet_bootstrap.cc:492] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.053284 15702 ts_tablet_manager.cc:1403] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.203s user 0.014s sys 0.005s
I20260204 08:57:21.072140 15704 tablet_bootstrap.cc:492] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.077181 15702 raft_consensus.cc:359] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.080471 15702 raft_consensus.cc:385] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.091946 15702 raft_consensus.cc:740] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.093408 15705 tablet_bootstrap.cc:492] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.094338 15702 consensus_queue.cc:260] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.099617 15704 tablet_bootstrap.cc:654] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.106979 15706 raft_consensus.cc:493] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.107512 15706 raft_consensus.cc:515] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.107903 15702 ts_tablet_manager.cc:1434] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.052s user 0.007s sys 0.008s
I20260204 08:57:21.112608 15610 heartbeater.cc:499] Master 127.15.3.254:32945 was elected leader, sending a full tablet report...
I20260204 08:57:21.116982 15702 tablet_bootstrap.cc:492] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:21.119176 15706 leader_election.cc:290] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.133152 15705 tablet_bootstrap.cc:654] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.141590 15704 tablet_bootstrap.cc:492] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.145880 15704 ts_tablet_manager.cc:1403] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.075s user 0.018s sys 0.001s
I20260204 08:57:21.146341 15702 tablet_bootstrap.cc:654] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.157181 15705 tablet_bootstrap.cc:492] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.157673 15705 ts_tablet_manager.cc:1403] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.065s user 0.008s sys 0.008s
I20260204 08:57:21.157639 15704 raft_consensus.cc:359] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.158561 15704 raft_consensus.cc:385] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.158866 15704 raft_consensus.cc:740] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.161057 15704 consensus_queue.cc:260] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.161800 15705 raft_consensus.cc:359] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.162982 15705 raft_consensus.cc:385] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.163290 15705 raft_consensus.cc:740] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.170300 15704 ts_tablet_manager.cc:1434] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.024s user 0.007s sys 0.003s
I20260204 08:57:21.169940 15535 heartbeater.cc:499] Master 127.15.3.254:32945 was elected leader, sending a full tablet report...
I20260204 08:57:21.166194 15705 consensus_queue.cc:260] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.173079 15702 tablet_bootstrap.cc:492] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.172060 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.173934 15704 tablet_bootstrap.cc:492] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.174054 15702 ts_tablet_manager.cc:1403] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.061s user 0.011s sys 0.005s
I20260204 08:57:21.176630 15702 raft_consensus.cc:359] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.177541 15702 raft_consensus.cc:385] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.177872 15702 raft_consensus.cc:740] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.180647 15659 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 0.
I20260204 08:57:21.188412 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:21.190140 15713 raft_consensus.cc:493] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.190541 15684 heartbeater.cc:499] Master 127.15.3.254:32945 was elected leader, sending a full tablet report...
I20260204 08:57:21.190616 15713 raft_consensus.cc:515] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.187726 15702 consensus_queue.cc:260] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.194670 15713 leader_election.cc:290] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.189435 15548 leader_election.cc:304] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:21.192979 15510 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 0.
I20260204 08:57:21.196440 15706 raft_consensus.cc:2804] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.197330 15706 raft_consensus.cc:493] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:21.198998 15705 ts_tablet_manager.cc:1434] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.041s user 0.003s sys 0.014s
I20260204 08:57:21.198999 15702 ts_tablet_manager.cc:1434] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260204 08:57:21.200408 15702 tablet_bootstrap.cc:492] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:21.197690 15706 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.202656 15705 tablet_bootstrap.cc:492] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.212189 15706 raft_consensus.cc:515] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.214283 15706 leader_election.cc:290] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.215947 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:21.216692 15659 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.217316 15702 tablet_bootstrap.cc:654] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.223023 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:21.227418 15510 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.227792 15659 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 1.
I20260204 08:57:21.230731 15705 tablet_bootstrap.cc:654] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.233726 15548 leader_election.cc:304] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:21.236276 15706 raft_consensus.cc:2804] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:21.236752 15706 raft_consensus.cc:697] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:21.237514 15706 consensus_queue.cc:237] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.249017 15702 tablet_bootstrap.cc:492] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.249513 15702 ts_tablet_manager.cc:1403] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.049s user 0.021s sys 0.002s
I20260204 08:57:21.262130 15510 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 1.
W20260204 08:57:21.275897 15685 tablet.cc:2378] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260204 08:57:21.275950 15705 tablet_bootstrap.cc:492] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.276681 15705 ts_tablet_manager.cc:1403] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.074s user 0.020s sys 0.000s
I20260204 08:57:21.285629 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.284729 15705 raft_consensus.cc:359] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.291879 15705 raft_consensus.cc:385] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.284868 15702 raft_consensus.cc:359] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.292445 15705 raft_consensus.cc:740] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.291826 15405 catalog_manager.cc:5654] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:21.292618 15702 raft_consensus.cc:385] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.291344 15704 tablet_bootstrap.cc:654] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.297425 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.298290 15659 raft_consensus.cc:2393] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46223e80af8440d1be13a306ea3b2639 in current term 1: Already voted for candidate 198cabb5672e440cb5d217975122fda1 in this term.
I20260204 08:57:21.299911 15473 leader_election.cc:304] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639; no voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:21.293431 15702 raft_consensus.cc:740] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.301306 15713 raft_consensus.cc:2749] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:21.302083 15702 consensus_queue.cc:260] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.303736 15704 tablet_bootstrap.cc:492] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.304195 15704 ts_tablet_manager.cc:1403] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.131s user 0.012s sys 0.006s
I20260204 08:57:21.304273 15705 consensus_queue.cc:260] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.306965 15704 raft_consensus.cc:359] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.307714 15704 raft_consensus.cc:385] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.308017 15704 raft_consensus.cc:740] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.308701 15704 consensus_queue.cc:260] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.306697 15702 ts_tablet_manager.cc:1434] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.057s user 0.002s sys 0.008s
I20260204 08:57:21.310400 15702 tablet_bootstrap.cc:492] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:21.311199 15704 ts_tablet_manager.cc:1434] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:57:21.309175 15705 ts_tablet_manager.cc:1434] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.032s user 0.005s sys 0.005s
I20260204 08:57:21.312170 15704 tablet_bootstrap.cc:492] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.312337 15705 tablet_bootstrap.cc:492] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.320806 15704 tablet_bootstrap.cc:654] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.325457 15702 tablet_bootstrap.cc:654] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.327162 15705 tablet_bootstrap.cc:654] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.339526 15704 tablet_bootstrap.cc:492] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.340037 15704 ts_tablet_manager.cc:1403] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.028s user 0.013s sys 0.006s
I20260204 08:57:21.342684 15704 raft_consensus.cc:359] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.343391 15704 raft_consensus.cc:385] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.343708 15704 raft_consensus.cc:740] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.348793 15705 tablet_bootstrap.cc:492] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.349330 15705 ts_tablet_manager.cc:1403] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.007s
I20260204 08:57:21.352619 15705 raft_consensus.cc:359] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.353349 15705 raft_consensus.cc:385] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.353654 15705 raft_consensus.cc:740] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.354369 15705 consensus_queue.cc:260] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.344383 15704 consensus_queue.cc:260] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.357843 15704 ts_tablet_manager.cc:1434] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260204 08:57:21.358686 15704 tablet_bootstrap.cc:492] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.364181 15702 tablet_bootstrap.cc:492] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.364625 15702 ts_tablet_manager.cc:1403] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.020s
I20260204 08:57:21.366986 15705 ts_tablet_manager.cc:1434] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.017s user 0.006s sys 0.002s
I20260204 08:57:21.367985 15705 tablet_bootstrap.cc:492] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.368064 15702 raft_consensus.cc:359] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.368809 15702 raft_consensus.cc:385] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.369107 15702 raft_consensus.cc:740] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.369839 15702 consensus_queue.cc:260] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.375952 15705 tablet_bootstrap.cc:654] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.376425 15702 ts_tablet_manager.cc:1434] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260204 08:57:21.377959 15702 tablet_bootstrap.cc:492] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:21.384526 15702 tablet_bootstrap.cc:654] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.393298 15704 tablet_bootstrap.cc:654] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.401378 15705 tablet_bootstrap.cc:492] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.401926 15705 ts_tablet_manager.cc:1403] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.026s
I20260204 08:57:21.403065 15702 tablet_bootstrap.cc:492] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.403524 15702 ts_tablet_manager.cc:1403] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.010s
I20260204 08:57:21.404670 15705 raft_consensus.cc:359] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.405395 15705 raft_consensus.cc:385] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.405673 15705 raft_consensus.cc:740] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.406280 15702 raft_consensus.cc:359] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.407004 15702 raft_consensus.cc:385] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.406414 15705 consensus_queue.cc:260] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.407224 15702 raft_consensus.cc:740] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.408010 15702 consensus_queue.cc:260] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.409042 15705 ts_tablet_manager.cc:1434] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:57:21.409967 15705 tablet_bootstrap.cc:492] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.410552 15702 ts_tablet_manager.cc:1434] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260204 08:57:21.412062 15702 tablet_bootstrap.cc:492] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:21.412964 15706 raft_consensus.cc:493] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.413444 15706 raft_consensus.cc:515] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.416914 15705 tablet_bootstrap.cc:654] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.418517 15706 leader_election.cc:290] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.420346 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.421305 15659 raft_consensus.cc:2468] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 0.
I20260204 08:57:21.422660 15548 leader_election.cc:304] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:21.422734 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:21.423593 15706 raft_consensus.cc:2804] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.423995 15706 raft_consensus.cc:493] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:21.424311 15706 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:57:21.425644 15549 leader_election.cc:343] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.431622 15702 tablet_bootstrap.cc:654] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.432101 15706 raft_consensus.cc:515] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.441337 15705 tablet_bootstrap.cc:492] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.441798 15705 ts_tablet_manager.cc:1403] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.003s
I20260204 08:57:21.433862 15704 tablet_bootstrap.cc:492] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.443562 15704 ts_tablet_manager.cc:1403] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.085s user 0.019s sys 0.001s
I20260204 08:57:21.443910 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639"
W20260204 08:57:21.445176 15549 leader_election.cc:343] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.446173 15705 raft_consensus.cc:359] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.446887 15705 raft_consensus.cc:385] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.447186 15705 raft_consensus.cc:740] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.447124 15704 raft_consensus.cc:359] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.447878 15704 raft_consensus.cc:385] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.448199 15704 raft_consensus.cc:740] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.447975 15705 consensus_queue.cc:260] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.450282 15705 ts_tablet_manager.cc:1434] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.008s user 0.000s sys 0.007s
I20260204 08:57:21.450205 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:21.450778 15659 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.451239 15705 tablet_bootstrap.cc:492] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.457453 15659 raft_consensus.cc:2468] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 1.
I20260204 08:57:21.458715 15705 tablet_bootstrap.cc:654] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.458596 15548 leader_election.cc:304] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters: 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:21.459606 15707 raft_consensus.cc:2804] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:21.466375 15706 leader_election.cc:290] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.465801 15704 consensus_queue.cc:260] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.472040 15704 ts_tablet_manager.cc:1434] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260204 08:57:21.473137 15704 tablet_bootstrap.cc:492] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.478209 15707 raft_consensus.cc:697] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:21.479203 15707 consensus_queue.cc:237] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.487159 15713 raft_consensus.cc:493] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.487766 15713 raft_consensus.cc:515] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.489825 15713 leader_election.cc:290] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.490782 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.491492 15585 raft_consensus.cc:2468] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 0.
I20260204 08:57:21.491573 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.493114 15476 leader_election.cc:304] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters:
W20260204 08:57:21.494359 15473 leader_election.cc:343] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.494532 15713 raft_consensus.cc:2804] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.499042 15713 raft_consensus.cc:493] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:21.499455 15713 raft_consensus.cc:3060] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.506955 15713 raft_consensus.cc:515] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.528900 15713 leader_election.cc:290] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.512326 15705 tablet_bootstrap.cc:492] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.529574 15705 ts_tablet_manager.cc:1403] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.079s user 0.040s sys 0.035s
I20260204 08:57:21.511293 15702 tablet_bootstrap.cc:492] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.529707 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:21.530004 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:21.530227 15702 ts_tablet_manager.cc:1403] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.119s user 0.028s sys 0.043s
I20260204 08:57:21.530274 15585 raft_consensus.cc:3060] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:57:21.531311 15473 leader_election.cc:343] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.518281 15404 catalog_manager.cc:5654] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:21.532263 15705 raft_consensus.cc:359] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.532939 15705 raft_consensus.cc:385] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.533244 15705 raft_consensus.cc:740] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.533593 15702 raft_consensus.cc:359] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.533905 15705 consensus_queue.cc:260] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.536304 15705 ts_tablet_manager.cc:1434] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260204 08:57:21.536918 15585 raft_consensus.cc:2468] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 1.
I20260204 08:57:21.537226 15705 tablet_bootstrap.cc:492] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.537951 15476 leader_election.cc:304] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters: 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:21.526064 15704 tablet_bootstrap.cc:654] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.542480 15713 raft_consensus.cc:2804] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:21.534487 15702 raft_consensus.cc:385] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.544500 15702 raft_consensus.cc:740] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.545255 15702 consensus_queue.cc:260] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.547890 15702 ts_tablet_manager.cc:1434] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.017s user 0.004s sys 0.002s
I20260204 08:57:21.548786 15702 tablet_bootstrap.cc:492] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:21.554845 15713 raft_consensus.cc:697] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:21.556408 15713 consensus_queue.cc:237] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.557964 15702 tablet_bootstrap.cc:654] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.562106 15705 tablet_bootstrap.cc:654] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.564229 15704 tablet_bootstrap.cc:492] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.564756 15704 ts_tablet_manager.cc:1403] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.092s user 0.016s sys 0.002s
I20260204 08:57:21.568142 15704 raft_consensus.cc:359] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.568892 15704 raft_consensus.cc:385] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.568840 15714 raft_consensus.cc:493] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.569278 15704 raft_consensus.cc:740] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.569485 15714 raft_consensus.cc:515] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.570112 15704 consensus_queue.cc:260] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.572347 15714 leader_election.cc:290] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:21.572636 15704 ts_tablet_manager.cc:1434] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260204 08:57:21.588840 15707 raft_consensus.cc:493] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.589340 15707 raft_consensus.cc:515] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.592039 15707 leader_election.cc:290] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.590780 15404 catalog_manager.cc:5654] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:21.595983 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.596180 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
W20260204 08:57:21.598044 15549 leader_election.cc:343] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:57:21.600863 15548 leader_election.cc:343] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.601295 15548 leader_election.cc:304] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 198cabb5672e440cb5d217975122fda1; no voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:21.602347 15707 raft_consensus.cc:2749] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:21.597577 15704 tablet_bootstrap.cc:492] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.612109 15702 tablet_bootstrap.cc:492] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.612617 15702 ts_tablet_manager.cc:1403] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.064s user 0.016s sys 0.013s
I20260204 08:57:21.613075 15705 tablet_bootstrap.cc:492] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.615065 15705 ts_tablet_manager.cc:1403] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.078s user 0.011s sys 0.014s
I20260204 08:57:21.615483 15702 raft_consensus.cc:359] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.617679 15713 raft_consensus.cc:493] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.618117 15713 raft_consensus.cc:515] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.620067 15713 leader_election.cc:290] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.621173 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.621762 15585 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 0.
I20260204 08:57:21.622963 15476 leader_election.cc:304] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters:
I20260204 08:57:21.621668 15705 raft_consensus.cc:359] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.623732 15713 raft_consensus.cc:2804] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.624563 15713 raft_consensus.cc:493] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:21.624905 15713 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.624455 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.628372 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:21.628659 15659 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 0.
I20260204 08:57:21.623852 15705 raft_consensus.cc:385] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.629532 15702 raft_consensus.cc:385] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.629873 15702 raft_consensus.cc:740] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.630535 15702 consensus_queue.cc:260] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.630995 15713 raft_consensus.cc:515] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.629549 15705 raft_consensus.cc:740] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.632690 15510 raft_consensus.cc:2393] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 875a583efe7b4643b2bdbd5c673f23e6 in current term 1: Already voted for candidate 46223e80af8440d1be13a306ea3b2639 in this term.
I20260204 08:57:21.632494 15705 consensus_queue.cc:260] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.633379 15713 leader_election.cc:290] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.635820 15705 ts_tablet_manager.cc:1434] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.020s user 0.005s sys 0.003s
I20260204 08:57:21.637923 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:21.638477 15704 tablet_bootstrap.cc:654] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.638698 15705 tablet_bootstrap.cc:492] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.637238 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:21.639372 15585 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.640597 15714 raft_consensus.cc:493] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.641026 15714 raft_consensus.cc:515] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.636317 15702 ts_tablet_manager.cc:1434] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260204 08:57:21.638445 15659 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.643164 15584 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.644467 15714 leader_election.cc:290] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:21.645377 15702 tablet_bootstrap.cc:492] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:21.651113 15659 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 1.
I20260204 08:57:21.648941 15625 leader_election.cc:304] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 875a583efe7b4643b2bdbd5c673f23e6; no voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:21.654357 15584 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
W20260204 08:57:21.656764 15625 leader_election.cc:343] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.656692 15473 leader_election.cc:304] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:21.657389 15714 raft_consensus.cc:2749] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:21.657510 15713 raft_consensus.cc:2804] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:21.652989 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:21.658035 15713 raft_consensus.cc:697] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
W20260204 08:57:21.659200 15623 leader_election.cc:343] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.660053 15623 leader_election.cc:304] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 875a583efe7b4643b2bdbd5c673f23e6; no voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:21.661464 15714 raft_consensus.cc:2749] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:21.658809 15713 consensus_queue.cc:237] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.659778 15704 tablet_bootstrap.cc:492] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.662330 15704 ts_tablet_manager.cc:1403] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.070s user 0.015s sys 0.005s
I20260204 08:57:21.665207 15585 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 1.
I20260204 08:57:21.664930 15704 raft_consensus.cc:359] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.665668 15704 raft_consensus.cc:385] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.669677 15705 tablet_bootstrap.cc:654] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.666479 15704 raft_consensus.cc:740] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.670935 15704 consensus_queue.cc:260] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.676508 15707 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:21.679432 15702 tablet_bootstrap.cc:654] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.681876 15704 ts_tablet_manager.cc:1434] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.019s user 0.006s sys 0.002s
I20260204 08:57:21.681500 15404 catalog_manager.cc:5654] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:21.683256 15704 tablet_bootstrap.cc:492] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.685508 15705 tablet_bootstrap.cc:492] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.685915 15705 ts_tablet_manager.cc:1403] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.047s user 0.017s sys 0.000s
I20260204 08:57:21.689467 15705 raft_consensus.cc:359] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.690162 15705 raft_consensus.cc:385] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.690424 15705 raft_consensus.cc:740] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.691092 15705 consensus_queue.cc:260] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.693363 15705 ts_tablet_manager.cc:1434] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260204 08:57:21.694207 15705 tablet_bootstrap.cc:492] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6: Bootstrap starting.
I20260204 08:57:21.694607 15704 tablet_bootstrap.cc:654] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.707401 15713 raft_consensus.cc:493] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.707978 15713 raft_consensus.cc:515] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.710701 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a26bd0dc6e64ad9b945e8f1adf29a3a" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
W20260204 08:57:21.712101 15476 leader_election.cc:343] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.713035 15713 leader_election.cc:290] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.714053 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a26bd0dc6e64ad9b945e8f1adf29a3a" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.714659 15659 raft_consensus.cc:2468] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 0.
I20260204 08:57:21.715787 15473 leader_election.cc:304] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters: 198cabb5672e440cb5d217975122fda1
I20260204 08:57:21.721230 15707 raft_consensus.cc:493] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.721758 15707 raft_consensus.cc:515] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.723853 15707 leader_election.cc:290] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.724743 15737 raft_consensus.cc:2804] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.725171 15737 raft_consensus.cc:493] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:21.725538 15737 raft_consensus.cc:3060] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.725859 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.725538 15714 raft_consensus.cc:493] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.727377 15714 raft_consensus.cc:515] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.725587 15713 raft_consensus.cc:493] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.729367 15714 leader_election.cc:290] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:21.729243 15713 raft_consensus.cc:515] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
W20260204 08:57:21.730350 15548 leader_election.cc:343] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.730778 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.731129 15713 leader_election.cc:290] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.731375 15585 raft_consensus.cc:2468] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 0.
I20260204 08:57:21.725009 15509 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:21.732640 15737 raft_consensus.cc:515] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.733650 15509 raft_consensus.cc:2468] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 0.
I20260204 08:57:21.732280 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:21.733681 15625 leader_election.cc:304] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:21.736023 15714 raft_consensus.cc:2804] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.736258 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.737416 15549 leader_election.cc:304] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters: 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:21.736387 15714 raft_consensus.cc:493] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 08:57:21.736177 15623 leader_election.cc:343] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:57:21.740438 15473 leader_election.cc:343] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.736508 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.739295 15714 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.745507 15702 tablet_bootstrap.cc:492] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.746744 15702 ts_tablet_manager.cc:1403] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.102s user 0.014s sys 0.012s
I20260204 08:57:21.744637 15706 raft_consensus.cc:2804] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.752719 15706 raft_consensus.cc:493] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:21.756362 15706 raft_consensus.cc:3060] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.758873 15702 raft_consensus.cc:359] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.759550 15702 raft_consensus.cc:385] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.759832 15702 raft_consensus.cc:740] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.760180 15733 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:57:21.760435 15702 consensus_queue.cc:260] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.768455 15706 raft_consensus.cc:515] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.770054 15705 tablet_bootstrap.cc:654] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.770856 15585 raft_consensus.cc:2393] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46223e80af8440d1be13a306ea3b2639 in current term 1: Already voted for candidate 198cabb5672e440cb5d217975122fda1 in this term.
I20260204 08:57:21.772161 15714 raft_consensus.cc:515] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.773025 15476 leader_election.cc:304] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639; no voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:21.779767 15713 raft_consensus.cc:3060] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.782481 15737 leader_election.cc:290] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.789508 15706 leader_election.cc:290] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.796599 15704 tablet_bootstrap.cc:492] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.790441 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a26bd0dc6e64ad9b945e8f1adf29a3a" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:21.800101 15704 ts_tablet_manager.cc:1403] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.116s user 0.019s sys 0.016s
I20260204 08:57:21.801616 15657 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:21.805835 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:21.805902 15704 raft_consensus.cc:359] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.809024 15704 raft_consensus.cc:385] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.807340 15702 ts_tablet_manager.cc:1434] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.060s user 0.019s sys 0.015s
W20260204 08:57:21.807826 15548 leader_election.cc:343] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.807893 15658 raft_consensus.cc:3060] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.810581 15702 tablet_bootstrap.cc:492] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1: Bootstrap starting.
I20260204 08:57:21.809145 15713 raft_consensus.cc:2749] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:21.809367 15704 raft_consensus.cc:740] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.825237 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:21.825937 15585 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.824949 15704 consensus_queue.cc:260] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.828629 15714 leader_election.cc:290] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
W20260204 08:57:21.830456 15476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:40285, user_credentials={real_user=slave}} blocked reactor thread for 57523.4us
I20260204 08:57:21.831373 15658 raft_consensus.cc:2468] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 1.
I20260204 08:57:21.832496 15473 leader_election.cc:304] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:21.833343 15713 raft_consensus.cc:2804] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:21.833847 15713 raft_consensus.cc:697] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:21.834683 15713 consensus_queue.cc:237] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.837327 15714 raft_consensus.cc:493] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.837772 15714 raft_consensus.cc:515] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.848006 15508 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.852085 15704 ts_tablet_manager.cc:1434] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.050s user 0.005s sys 0.001s
I20260204 08:57:21.852252 15714 leader_election.cc:290] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819)
I20260204 08:57:21.853538 15509 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:21.854938 15584 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.859474 15702 tablet_bootstrap.cc:654] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.859325 15583 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a26bd0dc6e64ad9b945e8f1adf29a3a" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:21.860102 15584 raft_consensus.cc:2393] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 875a583efe7b4643b2bdbd5c673f23e6 in current term 1: Already voted for candidate 46223e80af8440d1be13a306ea3b2639 in this term.
I20260204 08:57:21.860342 15704 tablet_bootstrap.cc:492] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.861094 15705 tablet_bootstrap.cc:492] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6: No bootstrap required, opened a new log
I20260204 08:57:21.863974 15705 ts_tablet_manager.cc:1403] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent bootstrapping tablet: real 0.170s user 0.011s sys 0.029s
I20260204 08:57:21.869652 15705 raft_consensus.cc:359] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.870153 15705 raft_consensus.cc:385] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.870364 15705 raft_consensus.cc:740] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.870816 15705 consensus_queue.cc:260] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.871553 15509 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639"
W20260204 08:57:21.871608 15476 leader_election.cc:343] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:21.874293 15705 ts_tablet_manager.cc:1434] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6: Time spent starting tablet: real 0.010s user 0.001s sys 0.004s
I20260204 08:57:21.874176 15585 raft_consensus.cc:2468] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 1.
I20260204 08:57:21.880240 15702 tablet_bootstrap.cc:492] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1: No bootstrap required, opened a new log
I20260204 08:57:21.880686 15702 ts_tablet_manager.cc:1403] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1: Time spent bootstrapping tablet: real 0.070s user 0.011s sys 0.000s
I20260204 08:57:21.882061 15509 raft_consensus.cc:2468] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 1.
I20260204 08:57:21.884027 15549 leader_election.cc:304] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters: 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:21.886333 15751 raft_consensus.cc:2804] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:21.886878 15751 raft_consensus.cc:697] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:21.887813 15751 consensus_queue.cc:237] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.894163 15713 raft_consensus.cc:493] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.894685 15713 raft_consensus.cc:515] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.895165 15508 raft_consensus.cc:2468] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 1.
I20260204 08:57:21.903088 15702 raft_consensus.cc:359] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.903785 15702 raft_consensus.cc:385] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.904067 15702 raft_consensus.cc:740] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.904253 15713 leader_election.cc:290] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.904590 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.905633 15704 tablet_bootstrap.cc:654] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.906423 15702 consensus_queue.cc:260] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.907966 15702 ts_tablet_manager.cc:1434] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20260204 08:57:21.908226 15625 leader_election.cc:304] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 875a583efe7b4643b2bdbd5c673f23e6; no voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:21.910008 15625 leader_election.cc:304] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:21.910828 15714 raft_consensus.cc:3060] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.914847 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.915933 15659 raft_consensus.cc:2393] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46223e80af8440d1be13a306ea3b2639 in current term 1: Already voted for candidate 198cabb5672e440cb5d217975122fda1 in this term.
I20260204 08:57:21.917157 15473 leader_election.cc:304] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639; no voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:21.915132 15752 raft_consensus.cc:2804] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:21.920509 15713 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:57:21.921710 15455 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:57:21.931337 15704 tablet_bootstrap.cc:492] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.931896 15704 ts_tablet_manager.cc:1403] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.072s user 0.015s sys 0.023s
I20260204 08:57:21.935993 15751 raft_consensus.cc:493] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.937153 15704 raft_consensus.cc:359] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.937285 15751 raft_consensus.cc:515] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.937837 15704 raft_consensus.cc:385] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:21.936832 15406 catalog_manager.cc:5654] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:21.938127 15704 raft_consensus.cc:740] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:21.931361 15403 catalog_manager.cc:5654] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:21.938758 15704 consensus_queue.cc:260] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.942915 15704 ts_tablet_manager.cc:1434] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260204 08:57:21.943789 15704 tablet_bootstrap.cc:492] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639: Bootstrap starting.
I20260204 08:57:21.944264 15753 raft_consensus.cc:493] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:21.944944 15753 raft_consensus.cc:515] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.945587 15714 raft_consensus.cc:2749] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:21.945250 15713 raft_consensus.cc:2749] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:21.948015 15753 leader_election.cc:290] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.949785 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.950537 15659 raft_consensus.cc:2468] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 0.
I20260204 08:57:21.950728 15751 leader_election.cc:290] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.951138 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:21.951738 15585 raft_consensus.cc:2468] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 0.
I20260204 08:57:21.954483 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:21.955090 15508 raft_consensus.cc:2468] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 0.
I20260204 08:57:21.951692 15473 leader_election.cc:304] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:21.956331 15704 tablet_bootstrap.cc:654] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:21.956372 15753 raft_consensus.cc:2804] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.956907 15753 raft_consensus.cc:493] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:21.957258 15753 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.957681 15549 leader_election.cc:304] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters:
I20260204 08:57:21.958456 15751 raft_consensus.cc:2804] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:21.958804 15751 raft_consensus.cc:493] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:21.959318 15751 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.965552 15753 raft_consensus.cc:515] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.965710 15751 raft_consensus.cc:515] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.967489 15751 leader_election.cc:290] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.969269 15753 leader_election.cc:290] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:21.969485 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:21.969985 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:21.970106 15658 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:21.970547 15585 raft_consensus.cc:2393] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 46223e80af8440d1be13a306ea3b2639 in current term 1: Already voted for candidate 198cabb5672e440cb5d217975122fda1 in this term.
I20260204 08:57:21.971689 15657 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:21.974570 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:21.975139 15508 raft_consensus.cc:2393] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 198cabb5672e440cb5d217975122fda1 in current term 1: Already voted for candidate 46223e80af8440d1be13a306ea3b2639 in this term.
I20260204 08:57:21.958714 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6" is_pre_election: true
I20260204 08:57:21.975963 15549 leader_election.cc:304] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 198cabb5672e440cb5d217975122fda1; no voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:21.976871 15658 raft_consensus.cc:2468] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 1.
I20260204 08:57:21.977329 15751 raft_consensus.cc:2749] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260204 08:57:21.977963 15473 leader_election.cc:304] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters: 198cabb5672e440cb5d217975122fda1
I20260204 08:57:21.979389 15713 raft_consensus.cc:2804] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:21.979864 15713 raft_consensus.cc:697] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:21.980685 15713 consensus_queue.cc:237] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.986313 15752 raft_consensus.cc:697] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Becoming Leader. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:21.988171 15751 consensus_queue.cc:1048] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:21.988737 15753 consensus_queue.cc:1048] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:21.989135 15752 consensus_queue.cc:237] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:21.999104 15704 tablet_bootstrap.cc:492] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639: No bootstrap required, opened a new log
I20260204 08:57:21.999552 15704 ts_tablet_manager.cc:1403] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639: Time spent bootstrapping tablet: real 0.056s user 0.013s sys 0.012s
I20260204 08:57:22.006578 15704 raft_consensus.cc:359] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.007266 15704 raft_consensus.cc:385] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:22.007548 15704 raft_consensus.cc:740] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Initialized, Role: FOLLOWER
I20260204 08:57:22.008394 15704 consensus_queue.cc:260] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.012151 15704 ts_tablet_manager.cc:1434] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260204 08:57:22.013296 15707 consensus_queue.cc:1048] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.007121 15404 catalog_manager.cc:5654] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:22.029860 15713 consensus_queue.cc:1048] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.038528 15406 catalog_manager.cc:5654] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:22.048863 15752 raft_consensus.cc:493] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:22.049386 15752 raft_consensus.cc:515] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.051810 15752 leader_election.cc:290] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:22.053071 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:22.053718 15585 raft_consensus.cc:2468] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 0.
I20260204 08:57:22.054697 15625 leader_election.cc:304] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:22.055569 15752 raft_consensus.cc:2804] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:22.055975 15752 raft_consensus.cc:493] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:22.055799 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:22.056425 15752 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:22.056758 15508 raft_consensus.cc:2468] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 0.
I20260204 08:57:22.063714 15752 raft_consensus.cc:515] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.065647 15752 leader_election.cc:290] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:22.066974 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:22.067018 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:22.067559 15585 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:22.067675 15508 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:22.071929 15585 raft_consensus.cc:2468] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 1.
I20260204 08:57:22.072832 15625 leader_election.cc:304] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:22.073452 15752 raft_consensus.cc:2804] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:22.073828 15752 raft_consensus.cc:697] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Becoming Leader. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:22.073987 15508 raft_consensus.cc:2468] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 1.
I20260204 08:57:22.074620 15752 consensus_queue.cc:237] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.081185 15406 catalog_manager.cc:5654] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:22.169816 15713 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.182931 15753 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:57:22.218886 15659 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
mode: GRACEFUL
new_leader_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:39720
I20260204 08:57:22.219602 15659 raft_consensus.cc:606] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Received request to transfer leadership to TS 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:22.220237 15752 raft_consensus.cc:493] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:22.221236 15752 raft_consensus.cc:515] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.222934 15752 leader_election.cc:290] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:22.223706 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46223e80af8440d1be13a306ea3b2639" is_pre_election: true
I20260204 08:57:22.224457 15508 raft_consensus.cc:2393] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 875a583efe7b4643b2bdbd5c673f23e6 in current term 1: Already voted for candidate 198cabb5672e440cb5d217975122fda1 in this term.
I20260204 08:57:22.224421 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "198cabb5672e440cb5d217975122fda1" is_pre_election: true
I20260204 08:57:22.228243 15625 leader_election.cc:304] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 875a583efe7b4643b2bdbd5c673f23e6; no voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:22.228992 15752 raft_consensus.cc:3060] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:22.229208 15585 raft_consensus.cc:3060] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:22.235898 15752 raft_consensus.cc:2749] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:22.237138 15583 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:47858
I20260204 08:57:22.237736 15583 raft_consensus.cc:606] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Received request to transfer leadership to TS 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:22.237946 15753 consensus_queue.cc:1048] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.243867 15585 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:47858
I20260204 08:57:22.244580 15585 raft_consensus.cc:606] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Received request to transfer leadership to TS 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:22.254086 15713 consensus_queue.cc:1048] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.282359 15508 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:54872
I20260204 08:57:22.282846 15508 raft_consensus.cc:606] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:22.288518 15508 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:54872
I20260204 08:57:22.288997 15508 raft_consensus.cc:606] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:22.293299 15659 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:39720
I20260204 08:57:22.293743 15659 raft_consensus.cc:606] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:22.297953 15508 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6a26bd0dc6e64ad9b945e8f1adf29a3a"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:54872
I20260204 08:57:22.298399 15508 raft_consensus.cc:606] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:22.303025 15583 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:47858
I20260204 08:57:22.303603 15583 raft_consensus.cc:606] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Received request to transfer leadership to TS 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:22.387686 15752 consensus_queue.cc:1048] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.394320 15761 raft_consensus.cc:993] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:22.394755 15761 raft_consensus.cc:1081] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:22.397562 15585 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47842
I20260204 08:57:22.398144 15585 raft_consensus.cc:493] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:22.398517 15585 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.402614 15714 consensus_queue.cc:1048] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.403440 15713 consensus_queue.cc:1048] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.409189 15585 raft_consensus.cc:515] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.411388 15585 leader_election.cc:290] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:22.412532 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:22.413138 15659 raft_consensus.cc:3055] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:22.413441 15659 raft_consensus.cc:740] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:22.414412 15659 consensus_queue.cc:260] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.416396 15659 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.416656 15509 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:22.425717 15707 consensus_queue.cc:1048] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.427103 15659 raft_consensus.cc:2468] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:22.429576 15548 leader_election.cc:304] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters: 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:22.430364 15707 raft_consensus.cc:2804] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:22.430845 15707 raft_consensus.cc:697] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:22.431596 15707 consensus_queue.cc:237] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.432758 15733 consensus_queue.cc:1048] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.433401 15713 raft_consensus.cc:993] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:22.433810 15713 raft_consensus.cc:1081] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:22.437361 15585 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47826
I20260204 08:57:22.437929 15585 raft_consensus.cc:493] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:22.438280 15585 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.440550 15753 consensus_queue.cc:1048] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:57:22.457948 15585 raft_consensus.cc:515] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.459910 15585 leader_election.cc:290] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:22.460669 15406 catalog_manager.cc:5654] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 1 to 2, leader changed from 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:22.463892 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:22.464164 15509 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:22.464516 15659 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.464715 15509 raft_consensus.cc:3055] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:22.465097 15509 raft_consensus.cc:740] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:22.465235 15584 raft_consensus.cc:1240] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Rejecting Update request from peer 46223e80af8440d1be13a306ea3b2639 for earlier term 1. Current term is 2. Ops: []
I20260204 08:57:22.465866 15509 consensus_queue.cc:260] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.467031 15509 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.471961 15659 raft_consensus.cc:2468] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:22.473134 15548 leader_election.cc:304] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:22.473968 15706 raft_consensus.cc:993] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1: : Instructing follower 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:22.474375 15706 raft_consensus.cc:1081] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Signalling peer 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:22.483819 15751 raft_consensus.cc:2804] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:22.484334 15751 raft_consensus.cc:697] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:22.484879 15659 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:39690
I20260204 08:57:22.485117 15751 consensus_queue.cc:237] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.489331 15659 raft_consensus.cc:493] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:22.489892 15659 raft_consensus.cc:3060] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.486263 15509 raft_consensus.cc:2468] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:22.498471 15659 raft_consensus.cc:515] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.500450 15405 catalog_manager.cc:5654] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 1 to 2, leader changed from 46223e80af8440d1be13a306ea3b2639 (127.15.3.193) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:22.501502 15509 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:22.502081 15509 raft_consensus.cc:3060] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.504532 15659 leader_election.cc:290] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 2 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:22.507020 15584 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85047792e5da4a3f973d187e09cfb631" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:22.508064 15584 raft_consensus.cc:3055] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:22.508381 15584 raft_consensus.cc:740] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:22.509076 15584 consensus_queue.cc:260] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.510035 15509 raft_consensus.cc:2468] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 2.
I20260204 08:57:22.510281 15584 raft_consensus.cc:3060] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.511023 15623 leader_election.cc:304] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:22.511834 15761 raft_consensus.cc:2804] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:22.512300 15761 raft_consensus.cc:697] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 LEADER]: Becoming Leader. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:22.513065 15761 consensus_queue.cc:237] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.518095 15584 raft_consensus.cc:2468] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 2.
I20260204 08:57:22.521497 15403 catalog_manager.cc:5654] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 reported cstate change: term changed from 1 to 2, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:22.528528 15751 raft_consensus.cc:993] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1: : Instructing follower 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:22.528956 15751 raft_consensus.cc:1081] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Signalling peer 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:22.530288 15509 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:54850
I20260204 08:57:22.530701 15509 raft_consensus.cc:493] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:22.530961 15509 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.535346 15509 raft_consensus.cc:515] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.536839 15509 leader_election.cc:290] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 2 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:22.537699 15584 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:22.537901 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:22.538398 15584 raft_consensus.cc:3055] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:22.538483 15659 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.538872 15584 raft_consensus.cc:740] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:22.540428 15584 consensus_queue.cc:260] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.541483 15584 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.545197 15659 raft_consensus.cc:2468] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 2.
I20260204 08:57:22.546121 15584 raft_consensus.cc:2468] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 2.
I20260204 08:57:22.546473 15473 leader_election.cc:304] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:22.547231 15713 raft_consensus.cc:2804] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:22.547670 15713 raft_consensus.cc:697] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:22.548367 15713 consensus_queue.cc:237] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.555001 15403 catalog_manager.cc:5654] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 1 to 2, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:22.575764 15761 consensus_queue.cc:1048] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.592984 15752 consensus_queue.cc:1048] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:22.606102 15714 raft_consensus.cc:993] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6: : Instructing follower 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:22.606551 15752 raft_consensus.cc:1081] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Signalling peer 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:22.611171 15509 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:54858
I20260204 08:57:22.611752 15509 raft_consensus.cc:493] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:22.612056 15509 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.616314 15509 raft_consensus.cc:515] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.618695 15584 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:22.619244 15584 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.620174 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:22.620682 15658 raft_consensus.cc:3055] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:22.620977 15658 raft_consensus.cc:740] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:22.621676 15658 consensus_queue.cc:260] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.622726 15658 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.626888 15707 raft_consensus.cc:993] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1: : Instructing follower 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:22.627326 15707 raft_consensus.cc:1081] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Signalling peer 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:22.628816 15508 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:54850
I20260204 08:57:22.629447 15508 raft_consensus.cc:493] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:22.629720 15508 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.634276 15508 raft_consensus.cc:515] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.635792 15509 leader_election.cc:290] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 2 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:22.639320 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:22.639948 15585 raft_consensus.cc:3055] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:22.640234 15508 leader_election.cc:290] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 2 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:22.640285 15585 raft_consensus.cc:740] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:22.640439 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:22.641018 15659 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.641119 15585 consensus_queue.cc:260] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.642078 15585 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.628831 15584 raft_consensus.cc:2468] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 2.
I20260204 08:57:22.644567 15476 leader_election.cc:304] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters:
I20260204 08:57:22.645453 15713 raft_consensus.cc:2804] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:22.645895 15713 raft_consensus.cc:697] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:22.646652 15713 consensus_queue.cc:237] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.648149 15659 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 2.
I20260204 08:57:22.650169 15473 leader_election.cc:304] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:22.650904 15713 raft_consensus.cc:2804] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:22.651122 15658 raft_consensus.cc:2468] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 2.
I20260204 08:57:22.651640 15713 raft_consensus.cc:697] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:22.652536 15713 consensus_queue.cc:237] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.653750 15405 catalog_manager.cc:5654] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 1 to 2, leader changed from 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195) to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:22.655890 15585 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 2.
I20260204 08:57:22.668362 15405 catalog_manager.cc:5654] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 1 to 2, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:22.715854 15753 raft_consensus.cc:993] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:22.716243 15713 raft_consensus.cc:1081] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:22.717551 15585 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47826
I20260204 08:57:22.718143 15585 raft_consensus.cc:493] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:22.718535 15585 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.724982 15585 raft_consensus.cc:515] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.727362 15585 leader_election.cc:290] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:22.728163 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:22.728394 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:22.728783 15508 raft_consensus.cc:3055] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:22.728988 15658 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.729125 15508 raft_consensus.cc:740] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:22.729789 15508 consensus_queue.cc:260] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.730680 15508 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.735304 15508 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:22.735939 15658 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:22.736214 15549 leader_election.cc:304] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters:
I20260204 08:57:22.736994 15751 raft_consensus.cc:2804] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:22.737458 15751 raft_consensus.cc:697] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:22.738179 15751 consensus_queue.cc:237] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.744410 15405 catalog_manager.cc:5654] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 1 to 2, leader changed from 46223e80af8440d1be13a306ea3b2639 (127.15.3.193) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:22.831606 15753 raft_consensus.cc:993] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:22.832043 15713 raft_consensus.cc:1081] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:22.833303 15585 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6a26bd0dc6e64ad9b945e8f1adf29a3a"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47826
I20260204 08:57:22.833834 15585 raft_consensus.cc:493] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:22.834205 15585 raft_consensus.cc:3060] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.840910 15585 raft_consensus.cc:515] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.842993 15585 leader_election.cc:290] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:22.843876 15508 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a26bd0dc6e64ad9b945e8f1adf29a3a" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:22.844012 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a26bd0dc6e64ad9b945e8f1adf29a3a" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:22.844483 15508 raft_consensus.cc:3055] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:22.844563 15658 raft_consensus.cc:3060] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.844861 15508 raft_consensus.cc:740] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:22.845686 15508 consensus_queue.cc:260] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.846530 15508 raft_consensus.cc:3060] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.850636 15508 raft_consensus.cc:2468] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:22.850939 15658 raft_consensus.cc:2468] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:22.851511 15549 leader_election.cc:304] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters:
I20260204 08:57:22.852254 15751 raft_consensus.cc:2804] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:22.852579 15751 raft_consensus.cc:697] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:22.853233 15751 consensus_queue.cc:237] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:22.860116 15405 catalog_manager.cc:5654] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 1 to 2, leader changed from 46223e80af8440d1be13a306ea3b2639 (127.15.3.193) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:22.920907 15658 raft_consensus.cc:1275] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:22.922351 15751 consensus_queue.cc:1048] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:22.924691 15508 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:22.938517 15509 raft_consensus.cc:1275] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:22.933108 15508 raft_consensus.cc:1275] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:22.939987 15752 consensus_queue.cc:1048] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:22.941324 15707 consensus_queue.cc:1048] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:22.955835 15585 raft_consensus.cc:1275] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:22.957294 15761 consensus_queue.cc:1048] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.025171 15509 raft_consensus.cc:1275] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.026428 15751 consensus_queue.cc:1048] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.034929 15658 raft_consensus.cc:1275] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.036417 15706 consensus_queue.cc:1048] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.068100 15585 raft_consensus.cc:1275] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.069257 15713 consensus_queue.cc:1048] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.077019 15658 raft_consensus.cc:1275] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.078284 15713 consensus_queue.cc:1048] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.093506 15585 raft_consensus.cc:1275] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.094467 15713 consensus_queue.cc:1048] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.101004 15658 raft_consensus.cc:1275] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.102247 15753 consensus_queue.cc:1048] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.135540 15658 raft_consensus.cc:1275] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.136746 15753 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.144295 15585 raft_consensus.cc:1275] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.146247 15713 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.292279 15658 raft_consensus.cc:1275] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.293346 15706 consensus_queue.cc:1048] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.300824 15509 raft_consensus.cc:1275] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.302241 15751 consensus_queue.cc:1048] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.315147 15658 raft_consensus.cc:1275] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.316165 15751 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:23.325615 15509 raft_consensus.cc:1275] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:23.326817 15794 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:25.329015 15375 auto_leader_rebalancer-test.cc:272] The leader distribution is
I20260204 08:57:25.329694 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:25.347977 15585 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:35502
I20260204 08:57:25.348443 15585 raft_consensus.cc:606] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Received request to transfer leadership to TS 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:25.357343 15510 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
mode: GRACEFUL
new_leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:39862
I20260204 08:57:25.357901 15510 raft_consensus.cc:606] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Received request to transfer leadership to TS 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:25.358932 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260204 08:57:25.359331 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:25.500622 15799 raft_consensus.cc:993] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1: : Instructing follower 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:25.501013 15794 raft_consensus.cc:1081] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Signalling peer 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:25.502357 15659 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:39690
I20260204 08:57:25.502802 15659 raft_consensus.cc:493] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:25.503072 15659 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:25.507262 15659 raft_consensus.cc:515] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:25.508833 15659 leader_election.cc:290] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 3 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:25.509593 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:25.509775 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:25.510171 15510 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:25.510219 15585 raft_consensus.cc:3055] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:57:25.510605 15585 raft_consensus.cc:740] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:25.511308 15585 consensus_queue.cc:260] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:25.512387 15585 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:25.516547 15510 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 3.
I20260204 08:57:25.517647 15623 leader_election.cc:304] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:25.518044 15585 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 3.
I20260204 08:57:25.518395 15761 raft_consensus.cc:2804] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:57:25.519407 15761 raft_consensus.cc:697] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Becoming Leader. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:25.520176 15761 consensus_queue.cc:237] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:25.525972 15405 catalog_manager.cc:5654] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 reported cstate change: term changed from 2 to 3, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:25.668928 15713 raft_consensus.cc:993] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639: : Instructing follower 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:25.669346 15806 raft_consensus.cc:1081] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Signalling peer 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:25.670802 15659 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:39704
I20260204 08:57:25.671267 15659 raft_consensus.cc:493] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:25.671536 15659 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:25.675251 15659 raft_consensus.cc:515] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:25.676726 15659 leader_election.cc:290] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 3 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:25.677661 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:25.677809 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:25.678123 15510 raft_consensus.cc:3055] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:57:25.678243 15585 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:25.678412 15510 raft_consensus.cc:740] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:25.679068 15510 consensus_queue.cc:260] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:25.679945 15510 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:25.682420 15585 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 3.
I20260204 08:57:25.683306 15625 leader_election.cc:304] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:25.683964 15761 raft_consensus.cc:2804] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:57:25.684357 15510 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 3.
I20260204 08:57:25.684446 15761 raft_consensus.cc:697] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Becoming Leader. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:25.685254 15761 consensus_queue.cc:237] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:25.693924 15405 catalog_manager.cc:5654] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 reported cstate change: term changed from 2 to 3, leader changed from 46223e80af8440d1be13a306ea3b2639 (127.15.3.193) to 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:26.003439 15510 raft_consensus.cc:1275] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:26.004829 15761 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:26.015419 15585 raft_consensus.cc:1275] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:26.017361 15761 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:26.096354 15585 raft_consensus.cc:1275] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:26.097393 15761 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:26.104812 15510 raft_consensus.cc:1275] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:26.107380 15810 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:26.360260 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:26.364890 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:26.365249 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:27.366031 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:27.371025 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:27.371402 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:28.372267 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:28.377058 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:28.377473 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:29.378540 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:29.383615 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:29.384075 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:30.385000 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:30.389577 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:30.390470 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:31.391371 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:31.396210 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:31.396585 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:32.397437 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:32.402690 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:32.403079 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:33.403857 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:33.409420 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:33.409794 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:34.410676 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:34.415570 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:34.416008 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:35.440303 15375 auto_leader_rebalancer-test.cc:291] The leader distribution is
I20260204 08:57:35.444239 15510 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:54872
I20260204 08:57:35.444860 15510 raft_consensus.cc:606] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:35.448906 15510 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:54872
I20260204 08:57:35.449298 15510 raft_consensus.cc:606] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:35.453039 15510 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:54872
I20260204 08:57:35.453435 15510 raft_consensus.cc:606] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:35.457518 15658 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:39720
I20260204 08:57:35.457948 15658 raft_consensus.cc:606] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:35.462096 15658 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
mode: GRACEFUL
new_leader_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:39720
I20260204 08:57:35.462525 15658 raft_consensus.cc:606] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Received request to transfer leadership to TS 198cabb5672e440cb5d217975122fda1
I20260204 08:57:35.628574 15824 raft_consensus.cc:993] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.629081 15806 raft_consensus.cc:1081] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.630407 15584 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47826
I20260204 08:57:35.630846 15584 raft_consensus.cc:493] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:35.631119 15584 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:35.635949 15584 raft_consensus.cc:515] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.637522 15584 leader_election.cc:290] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 3 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:35.638289 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:35.638607 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:35.638857 15510 raft_consensus.cc:3055] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:57:35.639103 15658 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:35.639114 15510 raft_consensus.cc:740] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:35.639900 15510 consensus_queue.cc:260] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.640769 15510 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:35.643617 15658 raft_consensus.cc:2468] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 3.
I20260204 08:57:35.644673 15510 raft_consensus.cc:2468] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 3.
I20260204 08:57:35.644727 15548 leader_election.cc:304] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:35.645838 15823 raft_consensus.cc:2804] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:57:35.646679 15823 raft_consensus.cc:697] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 3 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:35.647360 15823 consensus_queue.cc:237] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.654167 15403 catalog_manager.cc:5654] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 2 to 3, leader changed from 46223e80af8440d1be13a306ea3b2639 (127.15.3.193) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 3 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:35.669952 15824 raft_consensus.cc:993] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.670344 15806 raft_consensus.cc:1081] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.671674 15584 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47826
I20260204 08:57:35.672111 15584 raft_consensus.cc:493] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:35.672350 15584 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:35.676519 15584 raft_consensus.cc:515] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.677946 15584 leader_election.cc:290] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 3 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:35.678719 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:35.678932 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79b13b0d03e24d8e8e6c9c9e33e21cd4" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:35.679261 15510 raft_consensus.cc:3055] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:57:35.679409 15658 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:35.679562 15510 raft_consensus.cc:740] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:35.680239 15510 consensus_queue.cc:260] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.681413 15510 raft_consensus.cc:3060] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:35.685847 15658 raft_consensus.cc:2468] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 3.
I20260204 08:57:35.686982 15548 leader_election.cc:304] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:35.687407 15806 raft_consensus.cc:993] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.687855 15823 raft_consensus.cc:2804] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:57:35.687878 15806 raft_consensus.cc:1081] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.688500 15823 raft_consensus.cc:697] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 3 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:35.689430 15823 consensus_queue.cc:237] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.687433 15510 raft_consensus.cc:2468] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 3.
I20260204 08:57:35.689937 15584 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47826
I20260204 08:57:35.692399 15832 raft_consensus.cc:993] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.692812 15584 raft_consensus.cc:493] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:35.693115 15820 raft_consensus.cc:1081] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.693213 15584 raft_consensus.cc:3060] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:35.694947 15585 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47842
I20260204 08:57:35.695416 15585 raft_consensus.cc:493] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:35.695747 15585 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:35.698305 15403 catalog_manager.cc:5654] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 2 to 3, leader changed from 46223e80af8440d1be13a306ea3b2639 (127.15.3.193) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 3 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:35.698997 15584 raft_consensus.cc:515] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.701242 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:35.701319 15509 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60596298fe3c4d35b5398a77166c6fe9" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:35.701965 15509 raft_consensus.cc:3055] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:35.701884 15658 raft_consensus.cc:3060] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:35.701910 15585 raft_consensus.cc:515] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.702396 15509 raft_consensus.cc:740] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:35.703406 15584 leader_election.cc:290] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:35.704640 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:35.704339 15509 consensus_queue.cc:260] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.705039 15510 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:35.705586 15509 raft_consensus.cc:3060] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:35.708143 15585 leader_election.cc:290] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 4 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:35.708902 15510 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 4.
I20260204 08:57:35.708396 15658 raft_consensus.cc:2468] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:35.709168 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:35.709645 15659 raft_consensus.cc:3055] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:57:35.709942 15659 raft_consensus.cc:740] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:35.709975 15549 leader_election.cc:304] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters:
I20260204 08:57:35.710675 15659 consensus_queue.cc:260] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.711042 15548 leader_election.cc:304] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:35.711896 15659 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:35.711938 15825 raft_consensus.cc:2804] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:35.712597 15509 raft_consensus.cc:2468] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 2.
I20260204 08:57:35.710999 15823 raft_consensus.cc:2804] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:57:35.716982 15823 raft_consensus.cc:697] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:35.717803 15823 consensus_queue.cc:237] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.718153 15659 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 4.
I20260204 08:57:35.719367 15825 raft_consensus.cc:697] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:35.720144 15825 consensus_queue.cc:237] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.727037 15403 catalog_manager.cc:5654] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 1 to 2, leader changed from 46223e80af8440d1be13a306ea3b2639 (127.15.3.193) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:35.736903 15403 catalog_manager.cc:5654] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 3 to 4, leader changed from 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:35.747092 15832 raft_consensus.cc:993] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6: : Instructing follower 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.747488 15820 raft_consensus.cc:1081] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Signalling peer 198cabb5672e440cb5d217975122fda1 to start an election
I20260204 08:57:35.748723 15585 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
from {username='slave'} at 127.0.0.1:47842
I20260204 08:57:35.749115 15585 raft_consensus.cc:493] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:35.749363 15585 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:35.753091 15585 raft_consensus.cc:515] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.754298 15585 leader_election.cc:290] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 4 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:35.755131 15659 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:35.755092 15509 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "198cabb5672e440cb5d217975122fda1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:35.755681 15659 raft_consensus.cc:3055] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:57:35.755779 15509 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:35.755960 15659 raft_consensus.cc:740] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:35.756585 15659 consensus_queue.cc:260] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.757373 15659 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:35.760003 15509 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 4.
I20260204 08:57:35.760896 15549 leader_election.cc:304] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 198cabb5672e440cb5d217975122fda1, 46223e80af8440d1be13a306ea3b2639; no voters:
I20260204 08:57:35.761046 15659 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 198cabb5672e440cb5d217975122fda1 in term 4.
I20260204 08:57:35.761696 15825 raft_consensus.cc:2804] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:57:35.762125 15825 raft_consensus.cc:697] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Becoming Leader. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:35.762809 15825 consensus_queue.cc:237] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:35.768595 15403 catalog_manager.cc:5654] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 reported cstate change: term changed from 3 to 4, leader changed from 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195) to 198cabb5672e440cb5d217975122fda1 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "198cabb5672e440cb5d217975122fda1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:36.038527 15659 raft_consensus.cc:1275] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:36.039551 15823 consensus_queue.cc:1048] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:36.051753 15509 raft_consensus.cc:1275] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:36.053061 15834 consensus_queue.cc:1048] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:36.131206 15659 raft_consensus.cc:1275] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:36.131529 15658 raft_consensus.cc:1275] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:36.132282 15823 consensus_queue.cc:1048] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:36.132587 15834 consensus_queue.cc:1048] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:36.142048 15509 raft_consensus.cc:1275] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:36.143285 15510 raft_consensus.cc:1275] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:36.145130 15825 consensus_queue.cc:1048] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:36.145401 15834 consensus_queue.cc:1048] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:36.192461 15510 raft_consensus.cc:1275] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:57:36.193624 15846 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:57:36.201366 15659 raft_consensus.cc:1275] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:57:36.202936 15825 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:57:36.210204 15659 raft_consensus.cc:1275] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:57:36.211197 15825 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:57:36.219880 15510 raft_consensus.cc:1275] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Refusing update from remote peer 198cabb5672e440cb5d217975122fda1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:57:36.221072 15846 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:57:38.496277 15375 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20260204 08:57:38.496915 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:38.503262 15585 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:35502
I20260204 08:57:38.503866 15585 raft_consensus.cc:606] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Received request to transfer leadership to TS 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:38.506208 15585 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:35502
I20260204 08:57:38.506613 15585 raft_consensus.cc:606] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Received request to transfer leadership to TS 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:38.508543 15585 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:35502
I20260204 08:57:38.508967 15585 raft_consensus.cc:606] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Received request to transfer leadership to TS 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:38.511080 15585 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:35502
I20260204 08:57:38.511543 15585 raft_consensus.cc:606] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Received request to transfer leadership to TS 46223e80af8440d1be13a306ea3b2639
I20260204 08:57:38.513684 15585 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3"
dest_uuid: "198cabb5672e440cb5d217975122fda1"
mode: GRACEFUL
new_leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:35502
I20260204 08:57:38.514055 15585 raft_consensus.cc:606] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 3 LEADER]: Received request to transfer leadership to TS 875a583efe7b4643b2bdbd5c673f23e6
I20260204 08:57:38.514760 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260204 08:57:38.515144 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:38.709774 15853 raft_consensus.cc:993] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1: : Instructing follower 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:38.710397 15855 raft_consensus.cc:1081] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Signalling peer 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:38.711916 15510 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:54850
I20260204 08:57:38.712430 15510 raft_consensus.cc:493] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:38.712713 15510 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:57:38.717767 15510 raft_consensus.cc:515] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.719844 15510 leader_election.cc:290] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 5 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:38.721287 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:38.721289 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "036dfe47af3b414bb6ea037b9e52a065" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:38.722080 15658 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:57:38.722143 15585 raft_consensus.cc:3055] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:57:38.722442 15585 raft_consensus.cc:740] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:38.723032 15585 consensus_queue.cc:260] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.723968 15585 raft_consensus.cc:3060] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:57:38.726342 15658 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 5.
I20260204 08:57:38.727389 15473 leader_election.cc:304] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:38.728156 15585 raft_consensus.cc:2468] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 5.
I20260204 08:57:38.728999 15856 raft_consensus.cc:2804] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:57:38.729840 15856 raft_consensus.cc:697] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 5 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:38.730743 15856 consensus_queue.cc:237] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.737993 15406 catalog_manager.cc:5654] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 4 to 5, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 5 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:38.821063 15853 raft_consensus.cc:993] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1: : Instructing follower 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:38.821503 15855 raft_consensus.cc:1081] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Signalling peer 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:38.822711 15658 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:39690
I20260204 08:57:38.823100 15658 raft_consensus.cc:493] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:38.823338 15658 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:57:38.827178 15658 raft_consensus.cc:515] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.829018 15658 leader_election.cc:290] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 5 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:38.829962 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:38.830161 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a09733b3313d45d98b3ca0cb99a4a568" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:38.830518 15510 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:57:38.830601 15585 raft_consensus.cc:3055] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:57:38.830907 15585 raft_consensus.cc:740] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:38.831588 15585 consensus_queue.cc:260] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.832741 15585 raft_consensus.cc:3060] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:57:38.836375 15510 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 5.
I20260204 08:57:38.837700 15623 leader_election.cc:304] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:38.838608 15585 raft_consensus.cc:2468] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 5.
I20260204 08:57:38.838660 15820 raft_consensus.cc:2804] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:57:38.839978 15820 raft_consensus.cc:697] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 LEADER]: Becoming Leader. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:38.840842 15820 consensus_queue.cc:237] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.847949 15406 catalog_manager.cc:5654] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 reported cstate change: term changed from 4 to 5, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195). New cstate: current_term: 5 leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:38.855981 15853 raft_consensus.cc:993] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1: : Instructing follower 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:38.856400 15853 raft_consensus.cc:1081] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Signalling peer 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:38.857685 15510 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:54850
I20260204 08:57:38.858091 15510 raft_consensus.cc:493] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:38.858341 15510 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:38.862146 15510 raft_consensus.cc:515] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.863384 15510 leader_election.cc:290] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 3 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:38.864215 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:38.864284 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6687ad2d1ce4b8f9cbac10251985977" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:38.864631 15585 raft_consensus.cc:3055] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:57:38.864758 15658 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:38.864874 15585 raft_consensus.cc:740] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:38.865566 15585 consensus_queue.cc:260] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.866830 15585 raft_consensus.cc:3060] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:38.869040 15853 raft_consensus.cc:993] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1: : Instructing follower 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:38.869520 15853 raft_consensus.cc:1081] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 3 LEADER]: Signalling peer 875a583efe7b4643b2bdbd5c673f23e6 to start an election
I20260204 08:57:38.869902 15658 raft_consensus.cc:2468] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 3.
I20260204 08:57:38.870865 15658 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3"
dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
from {username='slave'} at 127.0.0.1:39690
I20260204 08:57:38.870893 15473 leader_election.cc:304] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:38.871335 15658 raft_consensus.cc:493] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:38.871691 15658 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:38.871703 15856 raft_consensus.cc:2804] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:57:38.872270 15856 raft_consensus.cc:697] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 3 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:38.873023 15585 raft_consensus.cc:2468] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 3.
I20260204 08:57:38.873093 15856 consensus_queue.cc:237] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.875768 15658 raft_consensus.cc:515] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.877341 15658 leader_election.cc:290] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 4 election: Requested vote from peers 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819), 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285)
I20260204 08:57:38.878391 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:38.878723 15510 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0fdf8822b3642169bf1c1a0b31578c3" candidate_uuid: "875a583efe7b4643b2bdbd5c673f23e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "46223e80af8440d1be13a306ea3b2639"
I20260204 08:57:38.878877 15585 raft_consensus.cc:3055] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:57:38.879159 15510 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:38.879192 15585 raft_consensus.cc:740] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:38.880028 15585 consensus_queue.cc:260] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.881122 15585 raft_consensus.cc:3060] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:57:38.880741 15406 catalog_manager.cc:5654] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 2 to 3, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 3 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:38.883292 15510 raft_consensus.cc:2468] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 4.
I20260204 08:57:38.884107 15623 leader_election.cc:304] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:38.884713 15820 raft_consensus.cc:2804] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:57:38.885064 15820 raft_consensus.cc:697] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 LEADER]: Becoming Leader. State: Replica: 875a583efe7b4643b2bdbd5c673f23e6, State: Running, Role: LEADER
I20260204 08:57:38.885810 15820 consensus_queue.cc:237] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.886613 15585 raft_consensus.cc:2468] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 875a583efe7b4643b2bdbd5c673f23e6 in term 4.
I20260204 08:57:38.893128 15406 catalog_manager.cc:5654] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 reported cstate change: term changed from 3 to 4, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195). New cstate: current_term: 4 leader_uuid: "875a583efe7b4643b2bdbd5c673f23e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:38.896756 15853 raft_consensus.cc:993] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1: : Instructing follower 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:38.897257 15855 raft_consensus.cc:1081] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Signalling peer 46223e80af8440d1be13a306ea3b2639 to start an election
I20260204 08:57:38.898562 15510 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf"
dest_uuid: "46223e80af8440d1be13a306ea3b2639"
from {username='slave'} at 127.0.0.1:54850
I20260204 08:57:38.898940 15510 raft_consensus.cc:493] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:38.899169 15510 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:38.903447 15510 raft_consensus.cc:515] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.904706 15510 leader_election.cc:290] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 3 election: Requested vote from peers 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285), 875a583efe7b4643b2bdbd5c673f23e6 (127.15.3.195:41451)
I20260204 08:57:38.905341 15585 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "198cabb5672e440cb5d217975122fda1"
I20260204 08:57:38.905565 15658 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a42896f90c0f4bf7883620541ebe16bf" candidate_uuid: "46223e80af8440d1be13a306ea3b2639" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "875a583efe7b4643b2bdbd5c673f23e6"
I20260204 08:57:38.906069 15658 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:38.905933 15585 raft_consensus.cc:3055] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:57:38.906507 15585 raft_consensus.cc:740] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 198cabb5672e440cb5d217975122fda1, State: Running, Role: LEADER
I20260204 08:57:38.907191 15585 consensus_queue.cc:260] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.908346 15585 raft_consensus.cc:3060] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:38.910256 15658 raft_consensus.cc:2468] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 3.
I20260204 08:57:38.911059 15473 leader_election.cc:304] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46223e80af8440d1be13a306ea3b2639, 875a583efe7b4643b2bdbd5c673f23e6; no voters:
I20260204 08:57:38.911674 15856 raft_consensus.cc:2804] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:57:38.912148 15856 raft_consensus.cc:697] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 3 LEADER]: Becoming Leader. State: Replica: 46223e80af8440d1be13a306ea3b2639, State: Running, Role: LEADER
I20260204 08:57:38.912825 15585 raft_consensus.cc:2468] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46223e80af8440d1be13a306ea3b2639 in term 3.
I20260204 08:57:38.912990 15856 consensus_queue.cc:237] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } }
I20260204 08:57:38.919808 15406 catalog_manager.cc:5654] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 reported cstate change: term changed from 2 to 3, leader changed from 198cabb5672e440cb5d217975122fda1 (127.15.3.194) to 46223e80af8440d1be13a306ea3b2639 (127.15.3.193). New cstate: current_term: 3 leader_uuid: "46223e80af8440d1be13a306ea3b2639" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:39.133512 15585 raft_consensus.cc:1275] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 5 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260204 08:57:39.134586 15856 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:57:39.143709 15658 raft_consensus.cc:1275] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260204 08:57:39.145327 15856 consensus_queue.cc:1048] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:57:39.239450 15510 raft_consensus.cc:1275] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 5 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260204 08:57:39.240511 15820 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:57:39.248912 15585 raft_consensus.cc:1275] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 5 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260204 08:57:39.250348 15863 consensus_queue.cc:1048] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:57:39.336253 15658 raft_consensus.cc:1275] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:39.337507 15857 consensus_queue.cc:1048] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:39.345657 15585 raft_consensus.cc:1275] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:39.347033 15857 consensus_queue.cc:1048] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:39.362372 15658 raft_consensus.cc:1275] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:39.363307 15857 consensus_queue.cc:1048] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "875a583efe7b4643b2bdbd5c673f23e6" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:39.371543 15585 raft_consensus.cc:1275] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Refusing update from remote peer 46223e80af8440d1be13a306ea3b2639: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:39.373024 15857 consensus_queue.cc:1048] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:39.382893 15585 raft_consensus.cc:1275] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:57:39.383973 15863 consensus_queue.cc:1048] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198cabb5672e440cb5d217975122fda1" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:57:39.392956 15510 raft_consensus.cc:1275] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Refusing update from remote peer 875a583efe7b4643b2bdbd5c673f23e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:57:39.394975 15820 consensus_queue.cc:1048] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46223e80af8440d1be13a306ea3b2639" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:57:39.516431 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:39.521138 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:39.521513 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:40.555392 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:40.560098 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:40.560487 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260204 08:57:40.647754 15438 debug-util.cc:398] Leaking SignalData structure 0x7b0800061060 after lost signal to thread 15378
W20260204 08:57:40.648463 15438 debug-util.cc:398] Leaking SignalData structure 0x7b0800061740 after lost signal to thread 15441
W20260204 08:57:40.649119 15438 debug-util.cc:398] Leaking SignalData structure 0x7b08001deb40 after lost signal to thread 15534
W20260204 08:57:40.649740 15438 debug-util.cc:398] Leaking SignalData structure 0x7b080018cf40 after lost signal to thread 15609
W20260204 08:57:40.650319 15438 debug-util.cc:398] Leaking SignalData structure 0x7b080010ba00 after lost signal to thread 15683
I20260204 08:57:41.561578 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:41.568684 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:41.569289 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:42.570353 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:42.575021 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:42.575436 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:43.664762 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:43.669893 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:43.670281 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260204 08:57:44.058872 15606 debug-util.cc:398] Leaking SignalData structure 0x7b080012c080 after lost signal to thread 15378
W20260204 08:57:44.059523 15606 debug-util.cc:398] Leaking SignalData structure 0x7b080012c760 after lost signal to thread 15441
W20260204 08:57:44.060249 15606 debug-util.cc:398] Leaking SignalData structure 0x7b0800117980 after lost signal to thread 15534
W20260204 08:57:44.060860 15606 debug-util.cc:398] Leaking SignalData structure 0x7b0800061ce0 after lost signal to thread 15609
W20260204 08:57:44.061443 15606 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8900 after lost signal to thread 15683
I20260204 08:57:44.671271 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:44.678480 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:44.678994 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:45.680166 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:45.687155 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:45.687628 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:46.688728 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:46.693454 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:46.693843 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:47.694748 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:47.699610 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:47.700026 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:48.726828 15375 auto_leader_rebalancer-test.cc:318] The leader distribution is
I20260204 08:57:48.727407 15375 tablet_server.cc:178] TabletServer@127.15.3.193:0 shutting down...
W20260204 08:57:48.739159 15623 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260204 08:57:48.745469 15623 consensus_peers.cc:597] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 -> Peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Couldn't send request to peer 46223e80af8440d1be13a306ea3b2639. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:57:48.746682 15549 consensus_peers.cc:597] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 -> Peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Couldn't send request to peer 46223e80af8440d1be13a306ea3b2639. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:57:48.760917 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:57:48.761822 15375 tablet_replica.cc:333] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.762560 15375 raft_consensus.cc:2243] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.763173 15375 raft_consensus.cc:2272] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.765451 15375 tablet_replica.cc:333] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.765998 15375 raft_consensus.cc:2243] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:57:48.766897 15375 raft_consensus.cc:2272] T a42896f90c0f4bf7883620541ebe16bf P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.768514 15375 tablet_replica.cc:333] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.768962 15375 raft_consensus.cc:2243] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.769387 15375 raft_consensus.cc:2272] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.770946 15375 tablet_replica.cc:333] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.771386 15375 raft_consensus.cc:2243] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 5 LEADER]: Raft consensus shutting down.
I20260204 08:57:48.772221 15375 raft_consensus.cc:2272] T 036dfe47af3b414bb6ea037b9e52a065 P 46223e80af8440d1be13a306ea3b2639 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.773754 15375 tablet_replica.cc:333] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.774251 15375 raft_consensus.cc:2243] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.774726 15375 raft_consensus.cc:2272] T d0fdf8822b3642169bf1c1a0b31578c3 P 46223e80af8440d1be13a306ea3b2639 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.776712 15375 tablet_replica.cc:333] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.777217 15375 raft_consensus.cc:2243] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.777721 15375 raft_consensus.cc:2272] T 60596298fe3c4d35b5398a77166c6fe9 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.779564 15375 tablet_replica.cc:333] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.780021 15375 raft_consensus.cc:2243] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:57:48.780841 15375 raft_consensus.cc:2272] T c6687ad2d1ce4b8f9cbac10251985977 P 46223e80af8440d1be13a306ea3b2639 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.782279 15375 tablet_replica.cc:333] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.782697 15375 raft_consensus.cc:2243] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.783071 15375 raft_consensus.cc:2272] T 85047792e5da4a3f973d187e09cfb631 P 46223e80af8440d1be13a306ea3b2639 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.784590 15375 tablet_replica.cc:333] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639: stopping tablet replica
I20260204 08:57:48.784970 15375 raft_consensus.cc:2243] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.785466 15375 raft_consensus.cc:2272] T a09733b3313d45d98b3ca0cb99a4a568 P 46223e80af8440d1be13a306ea3b2639 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260204 08:57:48.864022 15623 consensus_peers.cc:597] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 -> Peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Couldn't send request to peer 46223e80af8440d1be13a306ea3b2639. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:45819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:57:48.865499 15375 tablet_server.cc:195] TabletServer@127.15.3.193:0 shutdown complete.
I20260204 08:57:48.884130 15375 tablet_server.cc:178] TabletServer@127.15.3.194:0 shutting down...
W20260204 08:57:48.891848 15623 consensus_peers.cc:597] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 -> Peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Couldn't send request to peer 46223e80af8440d1be13a306ea3b2639. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:45819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:57:48.905499 15549 consensus_peers.cc:597] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 -> Peer 46223e80af8440d1be13a306ea3b2639 (127.15.3.193:45819): Couldn't send request to peer 46223e80af8440d1be13a306ea3b2639. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:45819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:57:48.911826 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:57:48.912492 15375 tablet_replica.cc:333] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.913048 15375 raft_consensus.cc:2243] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.913497 15375 raft_consensus.cc:2272] T a42896f90c0f4bf7883620541ebe16bf P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.915100 15375 tablet_replica.cc:333] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.915537 15375 raft_consensus.cc:2243] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.915985 15375 raft_consensus.cc:2272] T c6687ad2d1ce4b8f9cbac10251985977 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.917546 15375 tablet_replica.cc:333] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.917987 15375 raft_consensus.cc:2243] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.918403 15375 raft_consensus.cc:2272] T 85047792e5da4a3f973d187e09cfb631 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.920156 15375 tablet_replica.cc:333] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.920588 15375 raft_consensus.cc:2243] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:57:48.921341 15375 raft_consensus.cc:2272] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 198cabb5672e440cb5d217975122fda1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.922873 15375 tablet_replica.cc:333] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.923287 15375 raft_consensus.cc:2243] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:57:48.923960 15375 raft_consensus.cc:2272] T 60596298fe3c4d35b5398a77166c6fe9 P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.925407 15375 tablet_replica.cc:333] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.925809 15375 raft_consensus.cc:2243] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:57:48.926575 15375 raft_consensus.cc:2272] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 198cabb5672e440cb5d217975122fda1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.928036 15375 tablet_replica.cc:333] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.928500 15375 raft_consensus.cc:2243] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.928867 15375 raft_consensus.cc:2272] T 036dfe47af3b414bb6ea037b9e52a065 P 198cabb5672e440cb5d217975122fda1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.930274 15375 tablet_replica.cc:333] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.930655 15375 raft_consensus.cc:2243] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.931030 15375 raft_consensus.cc:2272] T d0fdf8822b3642169bf1c1a0b31578c3 P 198cabb5672e440cb5d217975122fda1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.932511 15375 tablet_replica.cc:333] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1: stopping tablet replica
I20260204 08:57:48.932859 15375 raft_consensus.cc:2243] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:48.933219 15375 raft_consensus.cc:2272] T a09733b3313d45d98b3ca0cb99a4a568 P 198cabb5672e440cb5d217975122fda1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:48.977838 15375 tablet_server.cc:195] TabletServer@127.15.3.194:0 shutdown complete.
W20260204 08:57:48.979977 15625 consensus_peers.cc:597] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 -> Peer 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285): Couldn't send request to peer 198cabb5672e440cb5d217975122fda1. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:40285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:57:48.995038 15375 tablet_server.cc:178] TabletServer@127.15.3.195:0 shutting down...
I20260204 08:57:49.017661 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:57:49.018324 15375 tablet_replica.cc:333] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.018905 15375 raft_consensus.cc:2243] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:49.019311 15375 raft_consensus.cc:2272] T 60596298fe3c4d35b5398a77166c6fe9 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.021039 15375 tablet_replica.cc:333] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.021486 15375 raft_consensus.cc:2243] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:49.022068 15375 raft_consensus.cc:2272] T 79b13b0d03e24d8e8e6c9c9e33e21cd4 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.024266 15375 tablet_replica.cc:333] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.024940 15375 raft_consensus.cc:2243] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 LEADER]: Raft consensus shutting down.
W20260204 08:57:49.025746 15625 consensus_peers.cc:597] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 -> Peer 198cabb5672e440cb5d217975122fda1 (127.15.3.194:40285): Couldn't send request to peer 198cabb5672e440cb5d217975122fda1. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:40285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:57:49.025931 15375 raft_consensus.cc:2272] T 85047792e5da4a3f973d187e09cfb631 P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.027590 15375 tablet_replica.cc:333] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.028117 15375 raft_consensus.cc:2243] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:49.028555 15375 raft_consensus.cc:2272] T c6687ad2d1ce4b8f9cbac10251985977 P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.030045 15375 tablet_replica.cc:333] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.030476 15375 raft_consensus.cc:2243] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:49.030831 15375 raft_consensus.cc:2272] T 036dfe47af3b414bb6ea037b9e52a065 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.032303 15375 tablet_replica.cc:333] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.032734 15375 raft_consensus.cc:2243] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 LEADER]: Raft consensus shutting down.
I20260204 08:57:49.033427 15375 raft_consensus.cc:2272] T d0fdf8822b3642169bf1c1a0b31578c3 P 875a583efe7b4643b2bdbd5c673f23e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.034852 15375 tablet_replica.cc:333] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.035250 15375 raft_consensus.cc:2243] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:49.035637 15375 raft_consensus.cc:2272] T 6a26bd0dc6e64ad9b945e8f1adf29a3a P 875a583efe7b4643b2bdbd5c673f23e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.037073 15375 tablet_replica.cc:333] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.037468 15375 raft_consensus.cc:2243] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:57:49.037868 15375 raft_consensus.cc:2272] T a42896f90c0f4bf7883620541ebe16bf P 875a583efe7b4643b2bdbd5c673f23e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.039283 15375 tablet_replica.cc:333] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6: stopping tablet replica
I20260204 08:57:49.039691 15375 raft_consensus.cc:2243] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 LEADER]: Raft consensus shutting down.
I20260204 08:57:49.040416 15375 raft_consensus.cc:2272] T a09733b3313d45d98b3ca0cb99a4a568 P 875a583efe7b4643b2bdbd5c673f23e6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.066627 15375 tablet_server.cc:195] TabletServer@127.15.3.195:0 shutdown complete.
I20260204 08:57:49.082953 15375 master.cc:561] Master@127.15.3.254:32945 shutting down...
I20260204 08:57:49.192027 15375 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:57:49.192602 15375 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:57:49.192926 15375 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9b068373f4d24fb6806ac88ac1f975ed: stopping tablet replica
I20260204 08:57:49.229967 15375 master.cc:583] Master@127.15.3.254:32945 shutdown complete.
198cabb5672e440cb5d217975122fda1 4
46223e80af8440d1be13a306ea3b2639 4
875a583efe7b4643b2bdbd5c673f23e6 1
198cabb5672e440cb5d217975122fda1 3
46223e80af8440d1be13a306ea3b2639 3
875a583efe7b4643b2bdbd5c673f23e6 3
198cabb5672e440cb5d217975122fda1 8
46223e80af8440d1be13a306ea3b2639 0
875a583efe7b4643b2bdbd5c673f23e6 1
198cabb5672e440cb5d217975122fda1 3
46223e80af8440d1be13a306ea3b2639 3
875a583efe7b4643b2bdbd5c673f23e6 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (30761 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260204 08:57:49.265636 15375 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.3.254:40951
I20260204 08:57:49.266731 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:57:49.273453 15893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:49.273524 15894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:49.274199 15896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:49.274859 15375 server_base.cc:1060] running on GCE node
I20260204 08:57:49.275640 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:57:49.275857 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:57:49.276005 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195469275987 us; error 0 us; skew 500 ppm
I20260204 08:57:49.276517 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:57:49.278744 15375 webserver.cc:492] Webserver started at http://127.15.3.254:35035/ using document root <none> and password file <none>
I20260204 08:57:49.279215 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:57:49.279397 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:57:49.279639 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:57:49.280851 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/master-0-root/instance:
uuid: "a860de6df1bf44b988affe64804630f6"
format_stamp: "Formatted at 2026-02-04 08:57:49 on dist-test-slave-3tf0"
I20260204 08:57:49.285030 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260204 08:57:49.288105 15901 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.288749 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260204 08:57:49.288998 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/master-0-root
uuid: "a860de6df1bf44b988affe64804630f6"
format_stamp: "Formatted at 2026-02-04 08:57:49 on dist-test-slave-3tf0"
I20260204 08:57:49.289233 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:57:49.301913 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:57:49.303130 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:57:49.338997 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.254:40951
I20260204 08:57:49.339079 15952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.254:40951 every 8 connection(s)
I20260204 08:57:49.342583 15953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.352064 15953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6: Bootstrap starting.
I20260204 08:57:49.356485 15953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:49.360322 15953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6: No bootstrap required, opened a new log
I20260204 08:57:49.362309 15953 raft_consensus.cc:359] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a860de6df1bf44b988affe64804630f6" member_type: VOTER }
I20260204 08:57:49.362708 15953 raft_consensus.cc:385] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:49.362891 15953 raft_consensus.cc:740] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a860de6df1bf44b988affe64804630f6, State: Initialized, Role: FOLLOWER
I20260204 08:57:49.363323 15953 consensus_queue.cc:260] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a860de6df1bf44b988affe64804630f6" member_type: VOTER }
I20260204 08:57:49.363765 15953 raft_consensus.cc:399] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 08:57:49.363961 15953 raft_consensus.cc:493] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 08:57:49.364169 15953 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:49.367857 15953 raft_consensus.cc:515] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a860de6df1bf44b988affe64804630f6" member_type: VOTER }
I20260204 08:57:49.368295 15953 leader_election.cc:304] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a860de6df1bf44b988affe64804630f6; no voters:
I20260204 08:57:49.369259 15953 leader_election.cc:290] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 08:57:49.369542 15956 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:49.370658 15956 raft_consensus.cc:697] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 1 LEADER]: Becoming Leader. State: Replica: a860de6df1bf44b988affe64804630f6, State: Running, Role: LEADER
I20260204 08:57:49.371280 15956 consensus_queue.cc:237] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a860de6df1bf44b988affe64804630f6" member_type: VOTER }
I20260204 08:57:49.372174 15953 sys_catalog.cc:565] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260204 08:57:49.376427 15958 sys_catalog.cc:455] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a860de6df1bf44b988affe64804630f6. Latest consensus state: current_term: 1 leader_uuid: "a860de6df1bf44b988affe64804630f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a860de6df1bf44b988affe64804630f6" member_type: VOTER } }
I20260204 08:57:49.377008 15958 sys_catalog.cc:458] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [sys.catalog]: This master's current role is: LEADER
I20260204 08:57:49.377923 15957 sys_catalog.cc:455] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a860de6df1bf44b988affe64804630f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a860de6df1bf44b988affe64804630f6" member_type: VOTER } }
I20260204 08:57:49.378446 15957 sys_catalog.cc:458] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [sys.catalog]: This master's current role is: LEADER
I20260204 08:57:49.378801 15964 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 08:57:49.383524 15964 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 08:57:49.385668 15375 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 08:57:49.391829 15964 catalog_manager.cc:1357] Generated new cluster ID: 0b07aa7a33da469f889e5fbb8255dc5f
I20260204 08:57:49.392107 15964 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 08:57:49.408752 15964 catalog_manager.cc:1380] Generated new certificate authority record
I20260204 08:57:49.409917 15964 catalog_manager.cc:1514] Loading token signing keys...
I20260204 08:57:49.426646 15964 catalog_manager.cc:6027] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6: Generated new TSK 0
I20260204 08:57:49.427210 15964 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 08:57:49.451912 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:57:49.457763 15974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:49.458305 15975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:49.460860 15977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:49.461091 15375 server_base.cc:1060] running on GCE node
I20260204 08:57:49.461951 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:57:49.462137 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:57:49.462272 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195469462260 us; error 0 us; skew 500 ppm
I20260204 08:57:49.462776 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:57:49.464923 15375 webserver.cc:492] Webserver started at http://127.15.3.193:40523/ using document root <none> and password file <none>
I20260204 08:57:49.465375 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:57:49.465549 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:57:49.465801 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:57:49.466758 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-0-root/instance:
uuid: "36c8394a94a144008e367ff1b5299b8f"
format_stamp: "Formatted at 2026-02-04 08:57:49 on dist-test-slave-3tf0"
I20260204 08:57:49.470839 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260204 08:57:49.473930 15982 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.474571 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260204 08:57:49.474831 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-0-root
uuid: "36c8394a94a144008e367ff1b5299b8f"
format_stamp: "Formatted at 2026-02-04 08:57:49 on dist-test-slave-3tf0"
I20260204 08:57:49.475090 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:57:49.494787 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:57:49.496006 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:57:49.497370 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:57:49.499454 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:57:49.499636 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.499868 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:57:49.500010 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.536389 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.193:44929
I20260204 08:57:49.536475 16044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.193:44929 every 8 connection(s)
I20260204 08:57:49.541015 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:57:49.547914 16050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:49.549664 16049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:49.551222 15375 server_base.cc:1060] running on GCE node
W20260204 08:57:49.552086 16052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:49.552975 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:57:49.553180 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:57:49.553347 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195469553321 us; error 0 us; skew 500 ppm
I20260204 08:57:49.553862 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:57:49.555871 16045 heartbeater.cc:344] Connected to a master server at 127.15.3.254:40951
I20260204 08:57:49.556351 16045 heartbeater.cc:461] Registering TS with master...
I20260204 08:57:49.556649 15375 webserver.cc:492] Webserver started at http://127.15.3.194:32961/ using document root <none> and password file <none>
I20260204 08:57:49.557042 16045 heartbeater.cc:507] Master 127.15.3.254:40951 requested a full tablet report, sending...
I20260204 08:57:49.557147 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:57:49.557345 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:57:49.557539 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:57:49.558549 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-1-root/instance:
uuid: "4e09378641cf441798c1a23f9cb2045f"
format_stamp: "Formatted at 2026-02-04 08:57:49 on dist-test-slave-3tf0"
I20260204 08:57:49.558758 15918 ts_manager.cc:194] Registered new tserver with Master: 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929)
I20260204 08:57:49.560413 15918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37724
I20260204 08:57:49.563001 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260204 08:57:49.565999 16057 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.566668 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260204 08:57:49.566915 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-1-root
uuid: "4e09378641cf441798c1a23f9cb2045f"
format_stamp: "Formatted at 2026-02-04 08:57:49 on dist-test-slave-3tf0"
I20260204 08:57:49.567152 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:57:49.595745 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:57:49.596897 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:57:49.598241 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:57:49.600309 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:57:49.600484 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.600723 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:57:49.600857 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.636577 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.194:34127
I20260204 08:57:49.636672 16119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.194:34127 every 8 connection(s)
I20260204 08:57:49.640831 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:57:49.647279 16123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:57:49.649029 16124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:49.650718 15375 server_base.cc:1060] running on GCE node
W20260204 08:57:49.651259 16126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:57:49.652359 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:57:49.652550 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:57:49.652755 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195469652736 us; error 0 us; skew 500 ppm
I20260204 08:57:49.652813 16120 heartbeater.cc:344] Connected to a master server at 127.15.3.254:40951
I20260204 08:57:49.653164 16120 heartbeater.cc:461] Registering TS with master...
I20260204 08:57:49.653316 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:57:49.653833 16120 heartbeater.cc:507] Master 127.15.3.254:40951 requested a full tablet report, sending...
I20260204 08:57:49.655766 15375 webserver.cc:492] Webserver started at http://127.15.3.195:38843/ using document root <none> and password file <none>
I20260204 08:57:49.655773 15918 ts_manager.cc:194] Registered new tserver with Master: 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:49.656294 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:57:49.656491 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:57:49.656728 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:57:49.657166 15918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37738
I20260204 08:57:49.657776 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-2-root/instance:
uuid: "38797974ab14462a9e8860b3fb88ca21"
format_stamp: "Formatted at 2026-02-04 08:57:49 on dist-test-slave-3tf0"
I20260204 08:57:49.661877 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260204 08:57:49.664839 16131 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.665484 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260204 08:57:49.665725 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-2-root
uuid: "38797974ab14462a9e8860b3fb88ca21"
format_stamp: "Formatted at 2026-02-04 08:57:49 on dist-test-slave-3tf0"
I20260204 08:57:49.665941 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770195438343508-15375-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:57:49.677644 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:57:49.678687 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:57:49.679982 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:57:49.682009 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:57:49.682199 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.682413 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:57:49.682556 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:57:49.718958 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.195:33753
I20260204 08:57:49.719046 16193 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.195:33753 every 8 connection(s)
I20260204 08:57:49.731043 16194 heartbeater.cc:344] Connected to a master server at 127.15.3.254:40951
I20260204 08:57:49.731386 16194 heartbeater.cc:461] Registering TS with master...
I20260204 08:57:49.732079 16194 heartbeater.cc:507] Master 127.15.3.254:40951 requested a full tablet report, sending...
I20260204 08:57:49.733747 15918 ts_manager.cc:194] Registered new tserver with Master: 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:49.733830 15375 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012035569s
I20260204 08:57:49.734990 15918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37752
I20260204 08:57:49.755663 15918 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37756:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260204 08:57:49.758335 15918 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260204 08:57:49.819887 16010 tablet_service.cc:1505] Processing CreateTablet for tablet 550327a783cf412899cd30e7528153d4 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260204 08:57:49.820535 16008 tablet_service.cc:1505] Processing CreateTablet for tablet 4aacec7256b84e748e4c563bdbda0f83 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260204 08:57:49.821393 16010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550327a783cf412899cd30e7528153d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.822788 16008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aacec7256b84e748e4c563bdbda0f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.823547 16007 tablet_service.cc:1505] Processing CreateTablet for tablet 14799dac72254241bd373b62e4f2d2d9 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260204 08:57:49.824823 16007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14799dac72254241bd373b62e4f2d2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.828796 16009 tablet_service.cc:1505] Processing CreateTablet for tablet e78a64d5fcb141929ebf131180e5f8f0 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260204 08:57:49.830066 16009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78a64d5fcb141929ebf131180e5f8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.831882 16004 tablet_service.cc:1505] Processing CreateTablet for tablet c0b0c5c3466a4b53911642d01b0bae02 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260204 08:57:49.833125 16004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b0c5c3466a4b53911642d01b0bae02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.833217 16005 tablet_service.cc:1505] Processing CreateTablet for tablet 5814881258624395bdc971cdc86ae91c (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260204 08:57:49.834465 16005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5814881258624395bdc971cdc86ae91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.835481 16003 tablet_service.cc:1505] Processing CreateTablet for tablet 5226181817d0491aa3569913ff102789 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260204 08:57:49.836724 16006 tablet_service.cc:1505] Processing CreateTablet for tablet dfca7b772ba84fe78bc563ef42ed1e29 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260204 08:57:49.837996 16006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfca7b772ba84fe78bc563ef42ed1e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.839087 16002 tablet_service.cc:1505] Processing CreateTablet for tablet 2e420edb8ea848e586ab02e701a5182d (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260204 08:57:49.840298 16002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e420edb8ea848e586ab02e701a5182d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.841807 16003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5226181817d0491aa3569913ff102789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.843807 16085 tablet_service.cc:1505] Processing CreateTablet for tablet 550327a783cf412899cd30e7528153d4 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260204 08:57:49.845079 16085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550327a783cf412899cd30e7528153d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.847530 16084 tablet_service.cc:1505] Processing CreateTablet for tablet e78a64d5fcb141929ebf131180e5f8f0 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260204 08:57:49.848903 16084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78a64d5fcb141929ebf131180e5f8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.859833 16001 tablet_service.cc:1505] Processing CreateTablet for tablet 5f7373c9ec18444186d4f63994370b20 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260204 08:57:49.861208 16001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7373c9ec18444186d4f63994370b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.862133 16209 tablet_bootstrap.cc:492] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:49.870543 16081 tablet_service.cc:1505] Processing CreateTablet for tablet dfca7b772ba84fe78bc563ef42ed1e29 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260204 08:57:49.872051 16081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfca7b772ba84fe78bc563ef42ed1e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.872406 16082 tablet_service.cc:1505] Processing CreateTablet for tablet 14799dac72254241bd373b62e4f2d2d9 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260204 08:57:49.873629 16082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14799dac72254241bd373b62e4f2d2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.870643 16083 tablet_service.cc:1505] Processing CreateTablet for tablet 4aacec7256b84e748e4c563bdbda0f83 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260204 08:57:49.875881 16083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aacec7256b84e748e4c563bdbda0f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.881397 16076 tablet_service.cc:1505] Processing CreateTablet for tablet 5f7373c9ec18444186d4f63994370b20 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260204 08:57:49.881613 16077 tablet_service.cc:1505] Processing CreateTablet for tablet 2e420edb8ea848e586ab02e701a5182d (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260204 08:57:49.882767 16076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7373c9ec18444186d4f63994370b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.883294 16080 tablet_service.cc:1505] Processing CreateTablet for tablet 5814881258624395bdc971cdc86ae91c (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260204 08:57:49.879878 16078 tablet_service.cc:1505] Processing CreateTablet for tablet 5226181817d0491aa3569913ff102789 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260204 08:57:49.887373 16079 tablet_service.cc:1505] Processing CreateTablet for tablet c0b0c5c3466a4b53911642d01b0bae02 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260204 08:57:49.896036 16078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5226181817d0491aa3569913ff102789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.896730 16077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e420edb8ea848e586ab02e701a5182d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.899610 16080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5814881258624395bdc971cdc86ae91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.904007 16079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b0c5c3466a4b53911642d01b0bae02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.886904 16209 tablet_bootstrap.cc:654] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:49.967047 16211 tablet_bootstrap.cc:492] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:49.967767 16209 tablet_bootstrap.cc:492] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:49.968242 16209 ts_tablet_manager.cc:1403] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.106s user 0.026s sys 0.000s
I20260204 08:57:49.969977 16156 tablet_service.cc:1505] Processing CreateTablet for tablet 14799dac72254241bd373b62e4f2d2d9 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260204 08:57:49.970448 16158 tablet_service.cc:1505] Processing CreateTablet for tablet e78a64d5fcb141929ebf131180e5f8f0 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260204 08:57:49.971364 16156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14799dac72254241bd373b62e4f2d2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.972066 16159 tablet_service.cc:1505] Processing CreateTablet for tablet 550327a783cf412899cd30e7528153d4 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260204 08:57:49.973376 16159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550327a783cf412899cd30e7528153d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.973172 16154 tablet_service.cc:1505] Processing CreateTablet for tablet 5814881258624395bdc971cdc86ae91c (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260204 08:57:49.974452 16154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5814881258624395bdc971cdc86ae91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.973342 16211 tablet_bootstrap.cc:654] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:49.975768 16150 tablet_service.cc:1505] Processing CreateTablet for tablet 5f7373c9ec18444186d4f63994370b20 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260204 08:57:49.984483 16150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7373c9ec18444186d4f63994370b20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.984239 16157 tablet_service.cc:1505] Processing CreateTablet for tablet 4aacec7256b84e748e4c563bdbda0f83 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260204 08:57:49.977380 16151 tablet_service.cc:1505] Processing CreateTablet for tablet 2e420edb8ea848e586ab02e701a5182d (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260204 08:57:49.985523 16157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aacec7256b84e748e4c563bdbda0f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.986084 16151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e420edb8ea848e586ab02e701a5182d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.988857 16209 raft_consensus.cc:359] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:49.980791 16153 tablet_service.cc:1505] Processing CreateTablet for tablet c0b0c5c3466a4b53911642d01b0bae02 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260204 08:57:49.982437 16155 tablet_service.cc:1505] Processing CreateTablet for tablet dfca7b772ba84fe78bc563ef42ed1e29 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260204 08:57:49.989918 16158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78a64d5fcb141929ebf131180e5f8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.979046 16152 tablet_service.cc:1505] Processing CreateTablet for tablet 5226181817d0491aa3569913ff102789 (DEFAULT_TABLE table=test-workload [id=a2cbe5565cc446ff80b44f7e6c32173f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260204 08:57:49.991410 16155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfca7b772ba84fe78bc563ef42ed1e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:49.991789 16209 raft_consensus.cc:385] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:49.993624 16152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5226181817d0491aa3569913ff102789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:50.000207 16153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b0c5c3466a4b53911642d01b0bae02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:57:50.007752 16209 raft_consensus.cc:740] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.008751 16209 consensus_queue.cc:260] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.022444 16209 ts_tablet_manager.cc:1434] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
I20260204 08:57:50.023216 16045 heartbeater.cc:499] Master 127.15.3.254:40951 was elected leader, sending a full tablet report...
I20260204 08:57:50.025856 16211 tablet_bootstrap.cc:492] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.026391 16211 ts_tablet_manager.cc:1403] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.007s
I20260204 08:57:50.029383 16211 raft_consensus.cc:359] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.030131 16211 raft_consensus.cc:385] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.030414 16211 raft_consensus.cc:740] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.036242 16209 tablet_bootstrap.cc:492] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:50.037307 16211 consensus_queue.cc:260] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.044320 16212 tablet_bootstrap.cc:492] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.048249 16209 tablet_bootstrap.cc:654] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.051442 16212 tablet_bootstrap.cc:654] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.056037 16120 heartbeater.cc:499] Master 127.15.3.254:40951 was elected leader, sending a full tablet report...
I20260204 08:57:50.057037 16211 ts_tablet_manager.cc:1434] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.030s user 0.010s sys 0.015s
I20260204 08:57:50.058126 16211 tablet_bootstrap.cc:492] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.064752 16211 tablet_bootstrap.cc:654] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.067539 16209 tablet_bootstrap.cc:492] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.068120 16209 ts_tablet_manager.cc:1403] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.032s user 0.013s sys 0.005s
I20260204 08:57:50.068984 16212 tablet_bootstrap.cc:492] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.069547 16212 ts_tablet_manager.cc:1403] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.012s
I20260204 08:57:50.070780 16209 raft_consensus.cc:359] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.071493 16209 raft_consensus.cc:385] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.071799 16209 raft_consensus.cc:740] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.072360 16212 raft_consensus.cc:359] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.072583 16209 consensus_queue.cc:260] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.073179 16212 raft_consensus.cc:385] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.073606 16212 raft_consensus.cc:740] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.074805 16209 ts_tablet_manager.cc:1434] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:57:50.074397 16212 consensus_queue.cc:260] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.075747 16209 tablet_bootstrap.cc:492] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:50.082188 16209 tablet_bootstrap.cc:654] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.097465 16194 heartbeater.cc:499] Master 127.15.3.254:40951 was elected leader, sending a full tablet report...
I20260204 08:57:50.098249 16212 ts_tablet_manager.cc:1434] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.028s user 0.007s sys 0.022s
I20260204 08:57:50.098851 16211 tablet_bootstrap.cc:492] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.099273 16212 tablet_bootstrap.cc:492] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.099375 16211 ts_tablet_manager.cc:1403] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.041s user 0.019s sys 0.021s
I20260204 08:57:50.099865 16209 tablet_bootstrap.cc:492] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.100298 16209 ts_tablet_manager.cc:1403] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.017s
I20260204 08:57:50.102314 16211 raft_consensus.cc:359] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.103086 16211 raft_consensus.cc:385] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.103475 16211 raft_consensus.cc:740] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.104241 16211 consensus_queue.cc:260] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.102792 16209 raft_consensus.cc:359] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.105898 16212 tablet_bootstrap.cc:654] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.106652 16211 ts_tablet_manager.cc:1434] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:57:50.107609 16211 tablet_bootstrap.cc:492] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.105115 16209 raft_consensus.cc:385] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.109014 16209 raft_consensus.cc:740] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.109799 16209 consensus_queue.cc:260] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.112833 16209 ts_tablet_manager.cc:1434] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.012s user 0.004s sys 0.003s
I20260204 08:57:50.113725 16209 tablet_bootstrap.cc:492] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:50.117784 16211 tablet_bootstrap.cc:654] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.119488 16209 tablet_bootstrap.cc:654] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.129549 16211 tablet_bootstrap.cc:492] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.130184 16211 ts_tablet_manager.cc:1403] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.004s
I20260204 08:57:50.133066 16211 raft_consensus.cc:359] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.134479 16211 raft_consensus.cc:385] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.134783 16211 raft_consensus.cc:740] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.135438 16211 consensus_queue.cc:260] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.137080 16214 raft_consensus.cc:493] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.137511 16214 raft_consensus.cc:515] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.138422 16212 tablet_bootstrap.cc:492] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.140183 16211 ts_tablet_manager.cc:1434] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260204 08:57:50.141108 16211 tablet_bootstrap.cc:492] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.141419 16212 ts_tablet_manager.cc:1403] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.042s user 0.028s sys 0.010s
I20260204 08:57:50.144116 16212 raft_consensus.cc:359] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.144776 16212 raft_consensus.cc:385] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.145057 16212 raft_consensus.cc:740] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.145812 16212 consensus_queue.cc:260] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.146974 16211 tablet_bootstrap.cc:654] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.148168 16212 ts_tablet_manager.cc:1434] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260204 08:57:50.149048 16212 tablet_bootstrap.cc:492] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.139963 16214 leader_election.cc:290] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.154940 16212 tablet_bootstrap.cc:654] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.155815 16211 tablet_bootstrap.cc:492] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.156525 16211 ts_tablet_manager.cc:1403] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.002s
I20260204 08:57:50.156805 16215 raft_consensus.cc:493] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.157238 16215 raft_consensus.cc:515] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.159309 16211 raft_consensus.cc:359] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.160068 16211 raft_consensus.cc:385] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.160393 16211 raft_consensus.cc:740] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.161123 16211 consensus_queue.cc:260] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.163594 16209 tablet_bootstrap.cc:492] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.164147 16209 ts_tablet_manager.cc:1403] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.012s
I20260204 08:57:50.166956 16209 raft_consensus.cc:359] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.159641 16215 leader_election.cc:290] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.177120 16209 raft_consensus.cc:385] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.177551 16209 raft_consensus.cc:740] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.182659 16209 consensus_queue.cc:260] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.196509 16209 ts_tablet_manager.cc:1434] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260204 08:57:50.197623 16209 tablet_bootstrap.cc:492] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:50.203683 16209 tablet_bootstrap.cc:654] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.204454 16215 raft_consensus.cc:493] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.204986 16215 raft_consensus.cc:515] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.207026 16215 leader_election.cc:290] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.211539 16169 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
W20260204 08:57:50.213455 15984 leader_election.cc:343] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.223486 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:50.224382 16211 ts_tablet_manager.cc:1434] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.067s user 0.018s sys 0.047s
I20260204 08:57:50.224306 16095 raft_consensus.cc:2468] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 0.
I20260204 08:57:50.227574 16211 tablet_bootstrap.cc:492] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.227744 15983 leader_election.cc:304] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters: 38797974ab14462a9e8860b3fb88ca21
I20260204 08:57:50.225742 16212 tablet_bootstrap.cc:492] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.226414 16209 tablet_bootstrap.cc:492] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.228875 16214 raft_consensus.cc:2804] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.229219 16214 raft_consensus.cc:493] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.229460 16212 ts_tablet_manager.cc:1403] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.081s user 0.043s sys 0.027s
I20260204 08:57:50.229591 16214 raft_consensus.cc:3060] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.229234 16209 ts_tablet_manager.cc:1403] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.000s
I20260204 08:57:50.233045 16212 raft_consensus.cc:359] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.233753 16212 raft_consensus.cc:385] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.234040 16212 raft_consensus.cc:740] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.234768 16212 consensus_queue.cc:260] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.235087 16209 raft_consensus.cc:359] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.235514 16211 tablet_bootstrap.cc:654] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.235761 16209 raft_consensus.cc:385] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.236090 16209 raft_consensus.cc:740] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.237282 16212 ts_tablet_manager.cc:1434] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:57:50.238261 16212 tablet_bootstrap.cc:492] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.236856 16209 consensus_queue.cc:260] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.243099 16169 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:57:50.244452 16212 tablet_bootstrap.cc:654] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.244575 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "550327a783cf412899cd30e7528153d4" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:57:50.245321 16168 raft_consensus.cc:2468] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 0.
W20260204 08:57:50.252925 16059 leader_election.cc:343] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.255239 16059 leader_election.cc:304] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.273988 16214 raft_consensus.cc:515] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.275959 16230 raft_consensus.cc:2804] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.276413 16230 raft_consensus.cc:493] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.276734 16230 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.278447 16219 raft_consensus.cc:493] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.278918 16219 raft_consensus.cc:515] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.279839 16212 tablet_bootstrap.cc:492] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.280391 16212 ts_tablet_manager.cc:1403] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.042s user 0.024s sys 0.005s
I20260204 08:57:50.283191 16212 raft_consensus.cc:359] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.283912 16219 leader_election.cc:290] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.297679 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.299111 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "550327a783cf412899cd30e7528153d4" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.299806 16019 raft_consensus.cc:2468] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 0.
I20260204 08:57:50.283934 16212 raft_consensus.cc:385] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260204 08:57:50.306039 16060 leader_election.cc:343] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.308383 16214 leader_election.cc:290] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.309517 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:50.310107 16095 raft_consensus.cc:3060] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.311023 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
W20260204 08:57:50.315867 15984 leader_election.cc:343] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.316900 16095 raft_consensus.cc:2468] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 1.
I20260204 08:57:50.318073 15983 leader_election.cc:304] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters: 38797974ab14462a9e8860b3fb88ca21
I20260204 08:57:50.317976 16060 leader_election.cc:304] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e09378641cf441798c1a23f9cb2045f; no voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21
I20260204 08:57:50.321076 16214 raft_consensus.cc:2804] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.321200 16215 raft_consensus.cc:2749] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:50.321525 16214 raft_consensus.cc:697] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:50.322279 16214 consensus_queue.cc:237] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.309291 16212 raft_consensus.cc:740] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.325069 16212 consensus_queue.cc:260] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.326402 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.326930 16219 raft_consensus.cc:493] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.327332 16219 raft_consensus.cc:515] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.328332 16211 tablet_bootstrap.cc:492] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.328410 16019 raft_consensus.cc:2468] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 0.
I20260204 08:57:50.328958 16211 ts_tablet_manager.cc:1403] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.102s user 0.045s sys 0.049s
I20260204 08:57:50.331947 16134 leader_election.cc:304] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21; no voters:
I20260204 08:57:50.331856 16230 raft_consensus.cc:515] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.333179 16211 raft_consensus.cc:359] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.333858 16211 raft_consensus.cc:385] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.334139 16211 raft_consensus.cc:740] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.334888 16219 leader_election.cc:290] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.335796 16219 raft_consensus.cc:2804] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.336171 16219 raft_consensus.cc:493] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.336570 16219 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.337869 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "550327a783cf412899cd30e7528153d4" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:50.338469 16019 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.340586 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:50.334923 16211 consensus_queue.cc:260] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.342957 16209 ts_tablet_manager.cc:1434] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.110s user 0.025s sys 0.015s
I20260204 08:57:50.343961 16209 tablet_bootstrap.cc:492] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:50.344667 16211 ts_tablet_manager.cc:1434] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.015s user 0.004s sys 0.002s
I20260204 08:57:50.346645 16211 tablet_bootstrap.cc:492] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.349035 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7373c9ec18444186d4f63994370b20" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
W20260204 08:57:50.350478 16132 leader_election.cc:343] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.348124 16219 raft_consensus.cc:515] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
W20260204 08:57:50.351099 16132 leader_election.cc:343] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.352309 16219 leader_election.cc:290] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.357004 16211 tablet_bootstrap.cc:654] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.358415 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
W20260204 08:57:50.359582 16132 leader_election.cc:343] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.360052 16019 raft_consensus.cc:2468] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 1.
I20260204 08:57:50.361255 16060 leader_election.cc:304] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.361802 16209 tablet_bootstrap.cc:654] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.362074 16215 raft_consensus.cc:2804] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.363446 16215 raft_consensus.cc:697] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Becoming Leader. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:57:50.364286 16215 consensus_queue.cc:237] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.379980 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "550327a783cf412899cd30e7528153d4" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:50.380568 16168 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.378263 16230 leader_election.cc:290] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
W20260204 08:57:50.384101 15966 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:57:50.387522 16209 tablet_bootstrap.cc:492] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.388055 16212 ts_tablet_manager.cc:1434] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.107s user 0.019s sys 0.032s
I20260204 08:57:50.388195 16211 tablet_bootstrap.cc:492] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.388754 16211 ts_tablet_manager.cc:1403] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.042s user 0.015s sys 0.013s
I20260204 08:57:50.388093 16209 ts_tablet_manager.cc:1403] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.006s
I20260204 08:57:50.389176 16212 tablet_bootstrap.cc:492] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.391490 16211 raft_consensus.cc:359] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.392246 16211 raft_consensus.cc:385] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.391935 16209 raft_consensus.cc:359] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.392587 16211 raft_consensus.cc:740] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.392921 16209 raft_consensus.cc:385] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.393297 16209 raft_consensus.cc:740] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.393429 16211 consensus_queue.cc:260] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.395857 16211 ts_tablet_manager.cc:1434] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260204 08:57:50.394281 16209 consensus_queue.cc:260] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.396904 16211 tablet_bootstrap.cc:492] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.397569 16212 tablet_bootstrap.cc:654] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.398767 16209 ts_tablet_manager.cc:1434] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260204 08:57:50.398084 15918 catalog_manager.cc:5654] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e09378641cf441798c1a23f9cb2045f (127.15.3.194). New cstate: current_term: 1 leader_uuid: "4e09378641cf441798c1a23f9cb2045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:50.399914 16209 tablet_bootstrap.cc:492] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
W20260204 08:57:50.382153 16134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:44929, user_credentials={real_user=slave}} blocked reactor thread for 51627.9us
I20260204 08:57:50.404130 16211 tablet_bootstrap.cc:654] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.404485 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:50.405068 16020 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.407256 16239 raft_consensus.cc:493] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.407792 16239 raft_consensus.cc:515] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.408964 16212 tablet_bootstrap.cc:492] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.409358 16212 ts_tablet_manager.cc:1403] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.013s
I20260204 08:57:50.411269 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:50.411458 16018 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.411929 16095 raft_consensus.cc:2468] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 0.
I20260204 08:57:50.412143 16018 raft_consensus.cc:2468] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 0.
I20260204 08:57:50.411895 16212 raft_consensus.cc:359] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.412688 16212 raft_consensus.cc:385] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.412955 16212 raft_consensus.cc:740] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.413537 16212 consensus_queue.cc:260] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.414702 16168 raft_consensus.cc:2468] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 1.
I20260204 08:57:50.415303 16212 ts_tablet_manager.cc:1434] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:57:50.404165 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7373c9ec18444186d4f63994370b20" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.416188 16212 tablet_bootstrap.cc:492] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.416244 16019 raft_consensus.cc:2468] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 0.
I20260204 08:57:50.417322 16132 leader_election.cc:304] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.418277 16219 raft_consensus.cc:2804] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.418630 16219 raft_consensus.cc:493] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.419373 16219 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.419603 15917 catalog_manager.cc:5654] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 1 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:50.423710 16134 leader_election.cc:304] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21; no voters: 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:50.424077 16020 raft_consensus.cc:2468] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 1.
I20260204 08:57:50.425252 16134 leader_election.cc:304] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21; no voters: 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:50.425472 16219 raft_consensus.cc:515] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.418645 16209 tablet_bootstrap.cc:654] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.427057 16241 raft_consensus.cc:2804] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.427435 16241 raft_consensus.cc:493] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.426079 16239 leader_election.cc:290] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.427801 16241 raft_consensus.cc:3060] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.432560 16239 raft_consensus.cc:2804] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.433113 16239 raft_consensus.cc:697] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:50.433894 16239 consensus_queue.cc:237] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.441287 16241 raft_consensus.cc:515] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.443255 16219 leader_election.cc:290] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.444518 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:50.445168 16095 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.452077 16212 tablet_bootstrap.cc:654] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.452538 16095 raft_consensus.cc:2468] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 1.
I20260204 08:57:50.453874 16132 leader_election.cc:304] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.455710 16248 raft_consensus.cc:2804] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.456244 16248 raft_consensus.cc:697] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:50.457104 16248 consensus_queue.cc:237] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.460276 16214 raft_consensus.cc:493] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.463472 16214 raft_consensus.cc:515] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.465468 16214 leader_election.cc:290] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.466964 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5226181817d0491aa3569913ff102789" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
W20260204 08:57:50.469244 15983 leader_election.cc:343] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.470109 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7373c9ec18444186d4f63994370b20" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
W20260204 08:57:50.471438 16132 leader_election.cc:343] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.472538 16230 raft_consensus.cc:493] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.472999 16230 raft_consensus.cc:515] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.474925 16230 leader_election.cc:290] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.481436 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e420edb8ea848e586ab02e701a5182d" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:57:50.482398 16168 raft_consensus.cc:2468] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 0.
I20260204 08:57:50.482852 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e420edb8ea848e586ab02e701a5182d" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.483598 16059 leader_election.cc:304] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.484086 16211 tablet_bootstrap.cc:492] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.484544 16211 ts_tablet_manager.cc:1403] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.088s user 0.015s sys 0.004s
I20260204 08:57:50.484494 16230 raft_consensus.cc:2804] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.485061 16230 raft_consensus.cc:493] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 08:57:50.484634 16060 leader_election.cc:343] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.485471 16230 raft_consensus.cc:3060] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.485065 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:50.486125 16020 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.487262 16211 raft_consensus.cc:359] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.488895 16211 raft_consensus.cc:385] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.489171 16211 raft_consensus.cc:740] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.489529 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f7373c9ec18444186d4f63994370b20" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:50.490039 16019 raft_consensus.cc:3060] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.489818 16211 consensus_queue.cc:260] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.491219 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5226181817d0491aa3569913ff102789" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:57:50.467258 16241 leader_election.cc:290] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.494284 16230 raft_consensus.cc:515] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
W20260204 08:57:50.494264 15984 leader_election.cc:343] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.495400 15984 leader_election.cc:304] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f; no voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:50.497170 16018 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e420edb8ea848e586ab02e701a5182d" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:50.497771 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e420edb8ea848e586ab02e701a5182d" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:50.498363 16168 raft_consensus.cc:3060] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.497763 16211 ts_tablet_manager.cc:1434] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260204 08:57:50.499080 16214 raft_consensus.cc:2749] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260204 08:57:50.498543 16060 leader_election.cc:343] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.501171 16230 leader_election.cc:290] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.499984 16211 tablet_bootstrap.cc:492] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.505013 16019 raft_consensus.cc:2468] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 1.
I20260204 08:57:50.505493 16020 raft_consensus.cc:2468] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 1.
I20260204 08:57:50.506142 16134 leader_election.cc:304] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21; no voters: 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:50.507895 16248 raft_consensus.cc:2804] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.508358 16248 raft_consensus.cc:697] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:50.509483 16211 tablet_bootstrap.cc:654] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.509127 16248 consensus_queue.cc:237] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.507146 16168 raft_consensus.cc:2468] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 1.
I20260204 08:57:50.520977 16209 tablet_bootstrap.cc:492] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.517194 16059 leader_election.cc:304] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters: 36c8394a94a144008e367ff1b5299b8f
I20260204 08:57:50.521445 16209 ts_tablet_manager.cc:1403] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.122s user 0.029s sys 0.030s
I20260204 08:57:50.519852 16212 tablet_bootstrap.cc:492] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.522621 16212 ts_tablet_manager.cc:1403] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.107s user 0.018s sys 0.013s
I20260204 08:57:50.523072 16230 raft_consensus.cc:2804] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.526904 16230 raft_consensus.cc:697] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Becoming Leader. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:57:50.527792 16230 consensus_queue.cc:237] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.528496 16212 raft_consensus.cc:359] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.529234 16212 raft_consensus.cc:385] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.529520 16212 raft_consensus.cc:740] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.530757 16211 tablet_bootstrap.cc:492] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.531141 16211 ts_tablet_manager.cc:1403] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.008s
I20260204 08:57:50.532661 16209 raft_consensus.cc:359] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.532912 16211 raft_consensus.cc:359] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.533241 16209 raft_consensus.cc:385] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.533535 16209 raft_consensus.cc:740] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.534031 16211 raft_consensus.cc:385] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.534250 16211 raft_consensus.cc:740] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.534092 16209 consensus_queue.cc:260] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.530337 16212 consensus_queue.cc:260] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.534719 16211 consensus_queue.cc:260] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.536852 16211 ts_tablet_manager.cc:1434] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:57:50.537015 16212 ts_tablet_manager.cc:1434] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260204 08:57:50.537698 16211 tablet_bootstrap.cc:492] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.539849 16212 tablet_bootstrap.cc:492] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.542074 16209 ts_tablet_manager.cc:1434] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.020s user 0.002s sys 0.005s
I20260204 08:57:50.542984 16209 tablet_bootstrap.cc:492] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:50.543205 16211 tablet_bootstrap.cc:654] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.548830 16209 tablet_bootstrap.cc:654] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.549044 15915 catalog_manager.cc:5654] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:50.550139 16212 tablet_bootstrap.cc:654] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.550776 15915 catalog_manager.cc:5654] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:50.566283 16211 tablet_bootstrap.cc:492] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.566594 16209 tablet_bootstrap.cc:492] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.566753 16211 ts_tablet_manager.cc:1403] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.014s
I20260204 08:57:50.566922 16212 tablet_bootstrap.cc:492] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.567431 16209 ts_tablet_manager.cc:1403] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.014s
I20260204 08:57:50.567668 16212 ts_tablet_manager.cc:1403] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.007s
I20260204 08:57:50.569579 16211 raft_consensus.cc:359] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.570221 16211 raft_consensus.cc:385] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.570611 16211 raft_consensus.cc:740] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.570266 16212 raft_consensus.cc:359] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.571262 16212 raft_consensus.cc:385] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.571254 16211 consensus_queue.cc:260] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.571803 16212 raft_consensus.cc:740] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.571842 16209 raft_consensus.cc:359] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.572791 16212 consensus_queue.cc:260] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.573609 16211 ts_tablet_manager.cc:1434] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260204 08:57:50.574491 16211 tablet_bootstrap.cc:492] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f: Bootstrap starting.
I20260204 08:57:50.574843 16212 ts_tablet_manager.cc:1434] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260204 08:57:50.574544 15918 catalog_manager.cc:5654] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e09378641cf441798c1a23f9cb2045f (127.15.3.194). New cstate: current_term: 1 leader_uuid: "4e09378641cf441798c1a23f9cb2045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:50.575773 16212 tablet_bootstrap.cc:492] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.572810 16209 raft_consensus.cc:385] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.576575 16209 raft_consensus.cc:740] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.577379 16209 consensus_queue.cc:260] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.581018 16211 tablet_bootstrap.cc:654] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.581183 16209 ts_tablet_manager.cc:1434] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260204 08:57:50.582036 16209 tablet_bootstrap.cc:492] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:50.582507 16214 raft_consensus.cc:493] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.582954 16214 raft_consensus.cc:515] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.584816 16214 leader_election.cc:290] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.587076 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:50.587366 16209 tablet_bootstrap.cc:654] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.587894 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
W20260204 08:57:50.589262 15984 leader_election.cc:343] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.589970 16095 raft_consensus.cc:2468] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 0.
I20260204 08:57:50.591272 15983 leader_election.cc:304] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters: 38797974ab14462a9e8860b3fb88ca21
I20260204 08:57:50.592468 16214 raft_consensus.cc:2804] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.592837 16214 raft_consensus.cc:493] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.593159 16214 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.593588 16248 raft_consensus.cc:493] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.594007 16248 raft_consensus.cc:515] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.596110 16212 tablet_bootstrap.cc:654] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.596199 16248 leader_election.cc:290] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.596895 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
W20260204 08:57:50.598627 16134 leader_election.cc:343] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.599458 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:50.600126 16095 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 0.
I20260204 08:57:50.601261 16132 leader_election.cc:304] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters: 36c8394a94a144008e367ff1b5299b8f
I20260204 08:57:50.602357 16248 raft_consensus.cc:2804] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.602739 16248 raft_consensus.cc:493] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.603212 16248 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.614338 16214 raft_consensus.cc:515] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.614866 16248 raft_consensus.cc:515] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.615325 16209 tablet_bootstrap.cc:492] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.618170 16209 ts_tablet_manager.cc:1403] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.003s
I20260204 08:57:50.615787 15917 catalog_manager.cc:5654] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:50.619014 16212 tablet_bootstrap.cc:492] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.619412 16212 ts_tablet_manager.cc:1403] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.010s
I20260204 08:57:50.620393 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:50.620566 16209 raft_consensus.cc:359] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.621166 16209 raft_consensus.cc:385] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.621423 16209 raft_consensus.cc:740] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.622015 16209 consensus_queue.cc:260] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.622387 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:50.622884 16095 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.624034 16209 ts_tablet_manager.cc:1434] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260204 08:57:50.624656 16214 leader_election.cc:290] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.624926 16209 tablet_bootstrap.cc:492] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f: Bootstrap starting.
I20260204 08:57:50.621733 16212 raft_consensus.cc:359] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.625738 16212 raft_consensus.cc:385] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.626008 16212 raft_consensus.cc:740] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.626627 16212 consensus_queue.cc:260] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.627900 16094 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:50.628499 16094 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.628767 16212 ts_tablet_manager.cc:1434] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.009s user 0.002s sys 0.003s
I20260204 08:57:50.629618 16212 tablet_bootstrap.cc:492] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.634078 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:50.635051 16212 tablet_bootstrap.cc:654] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.638008 16211 tablet_bootstrap.cc:492] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f: No bootstrap required, opened a new log
I20260204 08:57:50.638568 16211 ts_tablet_manager.cc:1403] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f: Time spent bootstrapping tablet: real 0.064s user 0.019s sys 0.019s
W20260204 08:57:50.638213 15984 leader_election.cc:343] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.637681 16248 leader_election.cc:290] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.638278 16019 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.640640 16209 tablet_bootstrap.cc:654] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.642925 16248 raft_consensus.cc:493] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.643330 16094 raft_consensus.cc:2468] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 1.
I20260204 08:57:50.644179 16211 raft_consensus.cc:359] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.644785 16211 raft_consensus.cc:385] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.645404 16214 raft_consensus.cc:493] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.645809 16214 raft_consensus.cc:515] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.646490 16095 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 1.
I20260204 08:57:50.646689 16248 raft_consensus.cc:515] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.647620 16132 leader_election.cc:304] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.644891 15983 leader_election.cc:304] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters: 38797974ab14462a9e8860b3fb88ca21
I20260204 08:57:50.645061 16211 raft_consensus.cc:740] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.648855 16239 raft_consensus.cc:2804] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.649262 16248 leader_election.cc:290] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.650055 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e420edb8ea848e586ab02e701a5182d" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:57:50.650842 16168 raft_consensus.cc:2393] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c8394a94a144008e367ff1b5299b8f in current term 1: Already voted for candidate 4e09378641cf441798c1a23f9cb2045f in this term.
I20260204 08:57:50.651418 16094 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:50.652107 16094 raft_consensus.cc:2468] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 0.
I20260204 08:57:50.652171 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.649371 16239 raft_consensus.cc:697] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:50.653085 16132 leader_election.cc:304] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.653692 16241 raft_consensus.cc:2804] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.654063 16241 raft_consensus.cc:493] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.653914 16239 consensus_queue.cc:237] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.654435 16241 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.654533 16019 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 1.
I20260204 08:57:50.649713 16234 raft_consensus.cc:2804] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader election won for term 1
W20260204 08:57:50.656678 16134 leader_election.cc:343] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.647619 16214 leader_election.cc:290] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.652181 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2e420edb8ea848e586ab02e701a5182d" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:50.665513 16234 raft_consensus.cc:697] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:50.666451 16234 consensus_queue.cc:237] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.649626 16211 consensus_queue.cc:260] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.663404 15983 leader_election.cc:304] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f; no voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:50.673166 16241 raft_consensus.cc:515] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.675081 16241 leader_election.cc:290] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.676110 16212 tablet_bootstrap.cc:492] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.676671 16212 ts_tablet_manager.cc:1403] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.047s user 0.020s sys 0.000s
I20260204 08:57:50.676842 16267 raft_consensus.cc:3060] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.678968 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:50.679279 16212 raft_consensus.cc:359] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.679991 16212 raft_consensus.cc:385] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.680258 16212 raft_consensus.cc:740] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.680877 16212 consensus_queue.cc:260] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
W20260204 08:57:50.682094 16134 leader_election.cc:343] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:57:50.683076 16212 ts_tablet_manager.cc:1434] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260204 08:57:50.682989 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:50.683714 16095 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.684201 16211 ts_tablet_manager.cc:1434] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f: Time spent starting tablet: real 0.045s user 0.005s sys 0.001s
I20260204 08:57:50.685159 16212 tablet_bootstrap.cc:492] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21: Bootstrap starting.
I20260204 08:57:50.685945 16209 tablet_bootstrap.cc:492] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f: No bootstrap required, opened a new log
I20260204 08:57:50.686333 16209 ts_tablet_manager.cc:1403] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.038s
I20260204 08:57:50.688700 16209 raft_consensus.cc:359] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.689146 16267 raft_consensus.cc:2749] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:50.690523 16212 tablet_bootstrap.cc:654] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21: Neither blocks nor log segments found. Creating new log.
I20260204 08:57:50.691424 16209 raft_consensus.cc:385] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.691752 16209 raft_consensus.cc:740] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.692353 16209 consensus_queue.cc:260] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.694387 16209 ts_tablet_manager.cc:1434] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260204 08:57:50.694133 15915 catalog_manager.cc:5654] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:50.697693 16212 tablet_bootstrap.cc:492] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21: No bootstrap required, opened a new log
I20260204 08:57:50.698063 16212 ts_tablet_manager.cc:1403] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.002s
I20260204 08:57:50.697817 15916 catalog_manager.cc:5654] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 1 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:50.700423 16212 raft_consensus.cc:359] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.701050 16212 raft_consensus.cc:385] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:57:50.701315 16212 raft_consensus.cc:740] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Initialized, Role: FOLLOWER
I20260204 08:57:50.701900 16212 consensus_queue.cc:260] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.703183 16095 raft_consensus.cc:2468] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 1.
I20260204 08:57:50.703969 16212 ts_tablet_manager.cc:1434] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260204 08:57:50.704702 16132 leader_election.cc:304] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters: 36c8394a94a144008e367ff1b5299b8f
I20260204 08:57:50.705742 16239 raft_consensus.cc:2804] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.706179 16239 raft_consensus.cc:697] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:50.706961 16239 consensus_queue.cc:237] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.716763 15915 catalog_manager.cc:5654] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:50.738852 16239 raft_consensus.cc:493] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.739346 16239 raft_consensus.cc:515] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.740931 16239 leader_election.cc:290] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:50.741721 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.741922 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:50.742591 16095 raft_consensus.cc:2393] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 38797974ab14462a9e8860b3fb88ca21 in current term 1: Already voted for candidate 36c8394a94a144008e367ff1b5299b8f in this term.
I20260204 08:57:50.743364 16132 leader_election.cc:304] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21; no voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:50.743978 16239 raft_consensus.cc:3060] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.748371 16239 raft_consensus.cc:2749] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:50.760399 16230 raft_consensus.cc:493] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.760776 16230 raft_consensus.cc:515] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.762153 16230 leader_election.cc:290] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.762930 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.763142 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:57:50.763514 16019 raft_consensus.cc:2393] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e09378641cf441798c1a23f9cb2045f in current term 1: Already voted for candidate 38797974ab14462a9e8860b3fb88ca21 in this term.
I20260204 08:57:50.764346 16060 leader_election.cc:304] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e09378641cf441798c1a23f9cb2045f; no voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21
I20260204 08:57:50.764891 16230 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.769307 16230 raft_consensus.cc:2749] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:50.783257 16230 consensus_queue.cc:1048] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:50.793202 16215 consensus_queue.cc:1048] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:50.824689 16267 consensus_queue.cc:1048] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:50.834393 16267 consensus_queue.cc:1048] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:50.858112 16215 raft_consensus.cc:493] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:50.858534 16215 raft_consensus.cc:515] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.860008 16215 leader_election.cc:290] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.860775 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5226181817d0491aa3569913ff102789" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:50.860978 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5226181817d0491aa3569913ff102789" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:57:50.861268 16019 raft_consensus.cc:2468] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 0.
I20260204 08:57:50.861609 16168 raft_consensus.cc:2468] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 0.
I20260204 08:57:50.862115 16060 leader_election.cc:304] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.863004 16215 raft_consensus.cc:2804] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:57:50.863355 16215 raft_consensus.cc:493] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:57:50.863600 16215 raft_consensus.cc:3060] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.868156 16215 raft_consensus.cc:515] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.869722 16215 leader_election.cc:290] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:50.870517 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5226181817d0491aa3569913ff102789" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:50.870971 16019 raft_consensus.cc:3060] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.870790 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5226181817d0491aa3569913ff102789" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:50.871435 16168 raft_consensus.cc:3060] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.872406 16239 consensus_queue.cc:1048] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:50.876631 16168 raft_consensus.cc:2468] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 1.
I20260204 08:57:50.876883 16019 raft_consensus.cc:2468] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 1.
I20260204 08:57:50.877820 16059 leader_election.cc:304] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:50.878595 16215 raft_consensus.cc:2804] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:57:50.879040 16215 raft_consensus.cc:697] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Becoming Leader. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:57:50.879839 16215 consensus_queue.cc:237] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:50.885588 16239 consensus_queue.cc:1048] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:50.891127 15916 catalog_manager.cc:5654] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e09378641cf441798c1a23f9cb2045f (127.15.3.194). New cstate: current_term: 1 leader_uuid: "4e09378641cf441798c1a23f9cb2045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:50.930562 16239 consensus_queue.cc:1048] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:50.940167 16239 consensus_queue.cc:1048] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:57:50.947685 16095 raft_consensus.cc:3060] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:50.953920 16219 consensus_queue.cc:1048] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:50.962688 16239 consensus_queue.cc:1048] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.035184 16095 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "550327a783cf412899cd30e7528153d4"
dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:43316
I20260204 08:57:51.035745 16095 raft_consensus.cc:606] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:57:51.042819 16234 raft_consensus.cc:493] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:51.043255 16234 raft_consensus.cc:515] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.045006 16234 leader_election.cc:290] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:51.045399 16239 raft_consensus.cc:493] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:57:51.045857 16239 raft_consensus.cc:515] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.047147 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:57:51.047856 16169 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:33080
I20260204 08:57:51.048398 16169 raft_consensus.cc:606] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:57:51.049196 16094 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:51.049331 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:57:51.049949 16094 raft_consensus.cc:2393] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 38797974ab14462a9e8860b3fb88ca21 in current term 1: Already voted for candidate 36c8394a94a144008e367ff1b5299b8f in this term.
I20260204 08:57:51.049968 16095 raft_consensus.cc:2393] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 36c8394a94a144008e367ff1b5299b8f in current term 1: Already voted for candidate 38797974ab14462a9e8860b3fb88ca21 in this term.
I20260204 08:57:51.050990 16215 consensus_queue.cc:1048] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.051316 15983 leader_election.cc:304] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f; no voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:51.052088 16234 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:51.052306 16239 leader_election.cc:290] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:51.052604 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36c8394a94a144008e367ff1b5299b8f" is_pre_election: true
I20260204 08:57:51.054006 16134 leader_election.cc:304] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21; no voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:51.055779 16239 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:57:51.060627 16234 raft_consensus.cc:2749] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:51.064239 16169 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:33080
I20260204 08:57:51.064857 16169 raft_consensus.cc:606] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:57:51.069200 16230 consensus_queue.cc:1048] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.070885 16169 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:33080
I20260204 08:57:51.071442 16169 raft_consensus.cc:606] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:57:51.077852 16169 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5814881258624395bdc971cdc86ae91c"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
mode: GRACEFUL
new_leader_uuid: "4e09378641cf441798c1a23f9cb2045f"
from {username='slave'} at 127.0.0.1:33080
I20260204 08:57:51.078284 16169 raft_consensus.cc:606] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Received request to transfer leadership to TS 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:51.080277 16239 raft_consensus.cc:2749] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:57:51.092523 16019 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
mode: GRACEFUL
new_leader_uuid: "4e09378641cf441798c1a23f9cb2045f"
from {username='slave'} at 127.0.0.1:37406
I20260204 08:57:51.093040 16019 raft_consensus.cc:606] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Received request to transfer leadership to TS 4e09378641cf441798c1a23f9cb2045f
I20260204 08:57:51.115530 16239 consensus_queue.cc:1048] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.116127 16234 consensus_queue.cc:1048] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.129025 16239 consensus_queue.cc:1048] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.131343 16267 consensus_queue.cc:1048] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.140208 16239 raft_consensus.cc:993] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:57:51.140744 16239 raft_consensus.cc:1081] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:57:51.142438 16019 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37402
I20260204 08:57:51.143040 16019 raft_consensus.cc:493] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:51.143409 16019 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.144204 16267 raft_consensus.cc:993] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f: : Instructing follower 4e09378641cf441798c1a23f9cb2045f to start an election
I20260204 08:57:51.144614 16267 raft_consensus.cc:1081] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Signalling peer 4e09378641cf441798c1a23f9cb2045f to start an election
I20260204 08:57:51.146435 16094 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02"
dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
from {username='slave'} at 127.0.0.1:43302
I20260204 08:57:51.146929 16094 raft_consensus.cc:493] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:51.147279 16094 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.150122 16019 raft_consensus.cc:515] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.152458 16019 leader_election.cc:290] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:51.152823 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:51.153399 16095 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.155738 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:51.156369 16168 raft_consensus.cc:3055] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:51.156741 16168 raft_consensus.cc:740] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:51.157524 16094 raft_consensus.cc:515] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.159966 16094 leader_election.cc:290] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 2 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:51.160244 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:51.160781 16019 raft_consensus.cc:3055] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:51.161057 16095 raft_consensus.cc:2468] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:57:51.157629 16168 consensus_queue.cc:260] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.161021 16169 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:51.162164 16169 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.162181 15983 leader_election.cc:304] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:51.162423 16168 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.163086 16234 raft_consensus.cc:2804] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:51.163591 16234 raft_consensus.cc:697] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:51.164423 16234 consensus_queue.cc:237] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.161094 16019 raft_consensus.cc:740] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:51.166738 16019 consensus_queue.cc:260] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.168226 16019 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.169817 16168 raft_consensus.cc:2468] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:57:51.170214 16169 raft_consensus.cc:2468] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 2.
I20260204 08:57:51.171814 16059 leader_election.cc:304] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:51.172806 16291 raft_consensus.cc:2804] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:51.173378 16291 raft_consensus.cc:697] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Becoming Leader. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:57:51.174106 16291 consensus_queue.cc:237] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.174577 16019 raft_consensus.cc:2468] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 2.
I20260204 08:57:51.174932 15916 catalog_manager.cc:5654] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 1 to 2, leader changed from 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 2 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:51.180962 15914 catalog_manager.cc:5654] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f reported cstate change: term changed from 1 to 2, leader changed from 36c8394a94a144008e367ff1b5299b8f (127.15.3.193) to 4e09378641cf441798c1a23f9cb2045f (127.15.3.194). New cstate: current_term: 2 leader_uuid: "4e09378641cf441798c1a23f9cb2045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:51.185573 16241 consensus_queue.cc:1048] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.195703 16219 consensus_queue.cc:1048] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.204806 16248 raft_consensus.cc:993] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:57:51.205246 16219 raft_consensus.cc:1081] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:57:51.206527 16019 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37402
I20260204 08:57:51.206960 16019 raft_consensus.cc:493] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:51.207217 16019 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.211828 16019 raft_consensus.cc:515] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.213264 16019 leader_election.cc:290] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:51.214313 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:51.214459 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:51.214869 16168 raft_consensus.cc:3055] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:51.214982 16095 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.215166 16168 raft_consensus.cc:740] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:51.215863 16168 consensus_queue.cc:260] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.216759 16168 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.220570 16095 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:57:51.221439 15983 leader_election.cc:304] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:51.221434 16168 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:57:51.222162 16234 raft_consensus.cc:2804] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:51.222625 16234 raft_consensus.cc:697] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:51.223302 16234 consensus_queue.cc:237] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.229100 15914 catalog_manager.cc:5654] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 1 to 2, leader changed from 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 2 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:51.307196 16291 consensus_queue.cc:1048] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.318701 16291 consensus_queue.cc:1048] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:57:51.327355 16248 raft_consensus.cc:993] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21: : Instructing follower 4e09378641cf441798c1a23f9cb2045f to start an election
I20260204 08:57:51.327765 16219 raft_consensus.cc:1081] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Signalling peer 4e09378641cf441798c1a23f9cb2045f to start an election
I20260204 08:57:51.329025 16095 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5814881258624395bdc971cdc86ae91c"
dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
from {username='slave'} at 127.0.0.1:43306
I20260204 08:57:51.329514 16095 raft_consensus.cc:493] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:51.329780 16095 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.334245 16095 raft_consensus.cc:515] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.335631 16095 leader_election.cc:290] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 2 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:51.336354 16019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:51.336539 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:51.336915 16019 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.337024 16168 raft_consensus.cc:3055] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:51.337343 16168 raft_consensus.cc:740] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:51.338256 16168 consensus_queue.cc:260] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.339402 16168 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.343432 16019 raft_consensus.cc:2468] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 2.
I20260204 08:57:51.344427 16215 raft_consensus.cc:993] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:57:51.344832 16291 raft_consensus.cc:1081] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:57:51.344842 16060 leader_election.cc:304] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:51.345474 16168 raft_consensus.cc:2468] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 2.
I20260204 08:57:51.345711 16291 raft_consensus.cc:2804] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:51.346153 16291 raft_consensus.cc:697] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Becoming Leader. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:57:51.346395 16019 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "550327a783cf412899cd30e7528153d4"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37398
I20260204 08:57:51.346915 16019 raft_consensus.cc:493] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:51.347324 16019 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.346917 16291 consensus_queue.cc:237] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.352558 16019 raft_consensus.cc:515] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.353055 15916 catalog_manager.cc:5654] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f reported cstate change: term changed from 1 to 2, leader changed from 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195) to 4e09378641cf441798c1a23f9cb2045f (127.15.3.194). New cstate: current_term: 2 leader_uuid: "4e09378641cf441798c1a23f9cb2045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:51.354235 16019 leader_election.cc:290] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:51.355237 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "550327a783cf412899cd30e7528153d4" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:51.355635 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "550327a783cf412899cd30e7528153d4" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:51.355892 16168 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.356240 16095 raft_consensus.cc:3055] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:51.356565 16095 raft_consensus.cc:740] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:57:51.361277 16095 consensus_queue.cc:260] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.362056 16168 raft_consensus.cc:2468] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:57:51.362246 16095 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.362996 15984 leader_election.cc:304] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21; no voters:
I20260204 08:57:51.363588 16234 raft_consensus.cc:2804] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:51.364064 16234 raft_consensus.cc:697] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:51.364806 16234 consensus_queue.cc:237] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.368108 16095 raft_consensus.cc:2468] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:57:51.371884 15916 catalog_manager.cc:5654] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 1 to 2, leader changed from 4e09378641cf441798c1a23f9cb2045f (127.15.3.194) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 2 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:51.468032 16239 raft_consensus.cc:993] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:57:51.468510 16219 raft_consensus.cc:1081] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:57:51.469918 16019 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37402
I20260204 08:57:51.470347 16019 raft_consensus.cc:493] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:51.470615 16019 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.474956 16019 raft_consensus.cc:515] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.476303 16019 leader_election.cc:290] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:57:51.477087 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:51.477182 16168 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:57:51.477702 16095 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.477771 16168 raft_consensus.cc:3055] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:57:51.478120 16168 raft_consensus.cc:740] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:51.478706 16168 consensus_queue.cc:260] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.479544 16168 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:57:51.481986 16095 raft_consensus.cc:2468] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:57:51.482884 15983 leader_election.cc:304] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:51.483460 16234 raft_consensus.cc:2804] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:57:51.483855 16234 raft_consensus.cc:697] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:51.483950 16168 raft_consensus.cc:2468] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:57:51.484575 16234 consensus_queue.cc:237] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:51.490096 15916 catalog_manager.cc:5654] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 1 to 2, leader changed from 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 2 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:57:51.549319 16168 raft_consensus.cc:1275] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.550384 16234 consensus_queue.cc:1048] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.556996 16095 raft_consensus.cc:1275] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.558992 16214 consensus_queue.cc:1048] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.672902 16168 raft_consensus.cc:1275] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Refusing update from remote peer 4e09378641cf441798c1a23f9cb2045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.674003 16291 consensus_queue.cc:1048] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.681318 16019 raft_consensus.cc:1275] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Refusing update from remote peer 4e09378641cf441798c1a23f9cb2045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.682504 16291 consensus_queue.cc:1048] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.765815 16168 raft_consensus.cc:1275] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.766928 16214 consensus_queue.cc:1048] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.775441 16095 raft_consensus.cc:1275] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.776985 16234 consensus_queue.cc:1048] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.788368 16095 raft_consensus.cc:1275] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.789532 16234 consensus_queue.cc:1048] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.797170 16168 raft_consensus.cc:1275] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.798768 16214 consensus_queue.cc:1048] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.830298 16019 raft_consensus.cc:1275] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Refusing update from remote peer 4e09378641cf441798c1a23f9cb2045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.831485 16291 consensus_queue.cc:1048] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.838071 16168 raft_consensus.cc:1275] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Refusing update from remote peer 4e09378641cf441798c1a23f9cb2045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.840953 16215 consensus_queue.cc:1048] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.923141 16095 raft_consensus.cc:1275] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.924212 16214 consensus_queue.cc:1048] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:57:51.931062 16168 raft_consensus.cc:1275] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:57:51.932595 16214 consensus_queue.cc:1048] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:57:54.130139 15375 auto_leader_rebalancer-test.cc:343] The leader distribution is
I20260204 08:57:54.130896 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:54.146562 16020 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
mode: GRACEFUL
new_leader_uuid: "38797974ab14462a9e8860b3fb88ca21"
from {username='slave'} at 127.0.0.1:47464
I20260204 08:57:54.147104 16020 raft_consensus.cc:606] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Received request to transfer leadership to TS 38797974ab14462a9e8860b3fb88ca21
I20260204 08:57:54.149206 16020 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
mode: GRACEFUL
new_leader_uuid: "38797974ab14462a9e8860b3fb88ca21"
from {username='slave'} at 127.0.0.1:47464
I20260204 08:57:54.149629 16020 raft_consensus.cc:606] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Received request to transfer leadership to TS 38797974ab14462a9e8860b3fb88ca21
I20260204 08:57:54.150444 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260204 08:57:54.150832 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:54.216581 16234 raft_consensus.cc:993] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f: : Instructing follower 38797974ab14462a9e8860b3fb88ca21 to start an election
I20260204 08:57:54.216981 16234 raft_consensus.cc:1081] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Signalling peer 38797974ab14462a9e8860b3fb88ca21 to start an election
I20260204 08:57:54.218410 16168 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
from {username='slave'} at 127.0.0.1:33072
I20260204 08:57:54.218814 16168 raft_consensus.cc:493] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:54.219051 16168 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:54.222923 16168 raft_consensus.cc:515] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:54.224253 16168 leader_election.cc:290] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 3 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:54.224951 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:54.225469 16020 raft_consensus.cc:3055] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:57:54.225411 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:54.225852 16020 raft_consensus.cc:740] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:54.226002 16095 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:54.226595 16020 consensus_queue.cc:260] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:54.227823 16020 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:54.231860 16095 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 3.
I20260204 08:57:54.232935 16132 leader_election.cc:304] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:54.233680 16219 raft_consensus.cc:2804] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:57:54.233871 16020 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 3.
I20260204 08:57:54.234572 16219 raft_consensus.cc:697] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:54.235383 16219 consensus_queue.cc:237] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:54.241734 15916 catalog_manager.cc:5654] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 2 to 3, leader changed from 36c8394a94a144008e367ff1b5299b8f (127.15.3.193) to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:54.427062 16307 raft_consensus.cc:993] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f: : Instructing follower 38797974ab14462a9e8860b3fb88ca21 to start an election
I20260204 08:57:54.427479 16234 raft_consensus.cc:1081] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Signalling peer 38797974ab14462a9e8860b3fb88ca21 to start an election
I20260204 08:57:54.429121 16169 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
from {username='slave'} at 127.0.0.1:33072
I20260204 08:57:54.429682 16169 raft_consensus.cc:493] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:57:54.430038 16169 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:54.435039 16169 raft_consensus.cc:515] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:54.436475 16169 leader_election.cc:290] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 3 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:57:54.437409 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:57:54.437464 16095 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:57:54.437954 16020 raft_consensus.cc:3055] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:57:54.438032 16095 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:54.438318 16020 raft_consensus.cc:740] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:57:54.438905 16020 consensus_queue.cc:260] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:54.439776 16020 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:57:54.442031 16095 raft_consensus.cc:2468] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 3.
I20260204 08:57:54.442857 16132 leader_election.cc:304] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:57:54.443500 16219 raft_consensus.cc:2804] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:57:54.443984 16219 raft_consensus.cc:697] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:57:54.444249 16020 raft_consensus.cc:2468] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 3.
I20260204 08:57:54.444741 16219 consensus_queue.cc:237] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:57:54.451139 15916 catalog_manager.cc:5654] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 2 to 3, leader changed from 36c8394a94a144008e367ff1b5299b8f (127.15.3.193) to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:57:54.615024 16095 raft_consensus.cc:1275] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Refusing update from remote peer 38797974ab14462a9e8860b3fb88ca21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:54.616117 16219 consensus_queue.cc:1048] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:54.625705 16020 raft_consensus.cc:1275] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Refusing update from remote peer 38797974ab14462a9e8860b3fb88ca21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:54.626924 16219 consensus_queue.cc:1048] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:54.929544 16095 raft_consensus.cc:1275] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Refusing update from remote peer 38797974ab14462a9e8860b3fb88ca21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:54.930694 16219 consensus_queue.cc:1048] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:54.938185 16020 raft_consensus.cc:1275] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Refusing update from remote peer 38797974ab14462a9e8860b3fb88ca21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:57:54.939704 16308 consensus_queue.cc:1048] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:57:55.151749 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:55.156957 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:55.157368 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:56.158243 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:56.163437 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:56.163861 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:57.164706 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:57.170660 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:57.171089 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:58.172014 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:58.177451 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:58.177845 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:57:59.179052 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:57:59.185935 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:57:59.186353 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:00.285252 16331 raft_consensus.cc:493] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4e09378641cf441798c1a23f9cb2045f)
I20260204 08:58:00.286139 16331 raft_consensus.cc:515] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:00.289093 16331 leader_election.cc:290] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:58:00.412307 16093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4e09378641cf441798c1a23f9cb2045f" is_pre_election: true
I20260204 08:58:00.420996 16167 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "38797974ab14462a9e8860b3fb88ca21" is_pre_election: true
I20260204 08:58:00.427209 15984 leader_election.cc:304] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f; no voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f
I20260204 08:58:00.427974 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:00.428140 16234 raft_consensus.cc:2749] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:58:00.434721 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:00.435113 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260204 08:58:00.775333 16041 debug-util.cc:398] Leaking SignalData structure 0x7b08001af9e0 after lost signal to thread 15378
W20260204 08:58:00.776130 16041 debug-util.cc:398] Leaking SignalData structure 0x7b080010e340 after lost signal to thread 15952
W20260204 08:58:00.776886 16041 debug-util.cc:398] Leaking SignalData structure 0x7b080011da60 after lost signal to thread 16044
W20260204 08:58:00.777549 16041 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1ec0 after lost signal to thread 16119
W20260204 08:58:00.778259 16041 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb1a0 after lost signal to thread 16193
I20260204 08:58:01.436022 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:01.442283 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:01.442723 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:02.443543 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:02.453320 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:02.453928 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:03.454862 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:03.461592 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:03.462040 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:04.490983 15375 auto_leader_rebalancer-test.cc:362] The leader distribution is
I20260204 08:58:04.497130 16169 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:33080
I20260204 08:58:04.497659 16169 raft_consensus.cc:606] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:58:04.505740 16169 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:33080
I20260204 08:58:04.506189 16169 raft_consensus.cc:606] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:58:04.510049 16093 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5814881258624395bdc971cdc86ae91c"
dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:43316
I20260204 08:58:04.510494 16093 raft_consensus.cc:606] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:58:04.514488 16093 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02"
dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:43316
I20260204 08:58:04.514957 16093 raft_consensus.cc:606] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:58:04.518744 16093 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5226181817d0491aa3569913ff102789"
dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
mode: GRACEFUL
new_leader_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:43316
I20260204 08:58:04.519189 16093 raft_consensus.cc:606] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Received request to transfer leadership to TS 36c8394a94a144008e367ff1b5299b8f
I20260204 08:58:04.608292 16337 raft_consensus.cc:993] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.608736 16339 raft_consensus.cc:1081] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.610116 16019 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37402
I20260204 08:58:04.610553 16019 raft_consensus.cc:493] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:04.610818 16019 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:04.615535 16019 raft_consensus.cc:515] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.616837 16019 leader_election.cc:290] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 4 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:58:04.617722 16093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:58:04.617722 16169 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e78a64d5fcb141929ebf131180e5f8f0" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:58:04.618289 16093 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:04.618502 16169 raft_consensus.cc:3055] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:58:04.618784 16169 raft_consensus.cc:740] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:58:04.619563 16169 consensus_queue.cc:260] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.620697 16169 raft_consensus.cc:3060] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:04.625388 16093 raft_consensus.cc:2468] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 4.
I20260204 08:58:04.626596 15983 leader_election.cc:304] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:58:04.626716 16169 raft_consensus.cc:2468] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 4.
I20260204 08:58:04.627336 16331 raft_consensus.cc:2804] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:58:04.628456 16331 raft_consensus.cc:697] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 4 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:04.629433 16331 consensus_queue.cc:237] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.638794 15916 catalog_manager.cc:5654] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 3 to 4, leader changed from 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 4 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:04.789083 16338 raft_consensus.cc:993] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.789609 16322 raft_consensus.cc:1081] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.790853 16019 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5226181817d0491aa3569913ff102789"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37398
I20260204 08:58:04.791236 16019 raft_consensus.cc:493] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:04.791453 16019 raft_consensus.cc:3060] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:04.795617 16019 raft_consensus.cc:515] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.796907 16019 leader_election.cc:290] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:58:04.797647 16093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5226181817d0491aa3569913ff102789" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:58:04.797821 16169 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5226181817d0491aa3569913ff102789" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:58:04.798182 16093 raft_consensus.cc:3055] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:04.798355 16169 raft_consensus.cc:3060] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:04.798584 16093 raft_consensus.cc:740] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:58:04.799361 16093 consensus_queue.cc:260] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.800372 16093 raft_consensus.cc:3060] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:04.802603 16169 raft_consensus.cc:2468] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:58:04.803455 15984 leader_election.cc:304] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21; no voters:
I20260204 08:58:04.804220 16331 raft_consensus.cc:2804] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:04.804575 16331 raft_consensus.cc:697] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:04.805181 16093 raft_consensus.cc:2468] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 2.
I20260204 08:58:04.805305 16331 consensus_queue.cc:237] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.810300 16338 raft_consensus.cc:993] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.810729 16322 raft_consensus.cc:1081] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.811931 16019 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37398
I20260204 08:58:04.812314 16019 raft_consensus.cc:493] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:04.812592 16019 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:04.812211 15916 catalog_manager.cc:5654] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 1 to 2, leader changed from 4e09378641cf441798c1a23f9cb2045f (127.15.3.194) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 2 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:04.817662 16019 raft_consensus.cc:515] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.819329 16019 leader_election.cc:290] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 3 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:58:04.820272 16093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:58:04.820822 16093 raft_consensus.cc:3055] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:04.821045 16093 raft_consensus.cc:740] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:58:04.821633 16169 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:58:04.821648 16093 consensus_queue.cc:260] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.822212 16169 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:04.822362 16338 raft_consensus.cc:993] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.822806 16322 raft_consensus.cc:1081] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.824137 16020 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5814881258624395bdc971cdc86ae91c"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37398
I20260204 08:58:04.824491 16020 raft_consensus.cc:493] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:04.824728 16020 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:04.826476 16093 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:04.829268 16020 raft_consensus.cc:515] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.830986 16020 leader_election.cc:290] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 3 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:58:04.829538 16169 raft_consensus.cc:2468] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 3.
I20260204 08:58:04.831806 16092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:58:04.832252 16093 raft_consensus.cc:2468] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 3.
I20260204 08:58:04.832404 16167 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5814881258624395bdc971cdc86ae91c" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:58:04.832406 16092 raft_consensus.cc:3055] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:04.832966 16167 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:04.833001 16092 raft_consensus.cc:740] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:58:04.833561 15983 leader_election.cc:304] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:58:04.833945 16092 consensus_queue.cc:260] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.834314 16331 raft_consensus.cc:2804] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:04.834795 16092 raft_consensus.cc:3060] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:04.834805 16331 raft_consensus.cc:697] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 3 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:04.835803 16331 consensus_queue.cc:237] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.837864 16167 raft_consensus.cc:2468] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 3.
I20260204 08:58:04.839793 15984 leader_election.cc:304] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 38797974ab14462a9e8860b3fb88ca21; no voters:
I20260204 08:58:04.840498 16340 raft_consensus.cc:2804] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:04.844434 16092 raft_consensus.cc:2468] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 3.
I20260204 08:58:04.846149 16340 raft_consensus.cc:697] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 3 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:04.847028 16340 consensus_queue.cc:237] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.848039 15916 catalog_manager.cc:5654] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 2 to 3, leader changed from 4e09378641cf441798c1a23f9cb2045f (127.15.3.194) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 3 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:04.859444 15916 catalog_manager.cc:5654] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 2 to 3, leader changed from 4e09378641cf441798c1a23f9cb2045f (127.15.3.194) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 3 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:04.980083 16337 raft_consensus.cc:993] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21: : Instructing follower 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.980504 16339 raft_consensus.cc:1081] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Signalling peer 36c8394a94a144008e367ff1b5299b8f to start an election
I20260204 08:58:04.981740 16020 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
from {username='slave'} at 127.0.0.1:37402
I20260204 08:58:04.982131 16020 raft_consensus.cc:493] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:04.982405 16020 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:04.986351 16020 raft_consensus.cc:515] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.987740 16020 leader_election.cc:290] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 4 election: Requested vote from peers 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:58:04.988565 16092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:58:04.988673 16167 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfca7b772ba84fe78bc563ef42ed1e29" candidate_uuid: "36c8394a94a144008e367ff1b5299b8f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:58:04.989010 16092 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:04.989137 16167 raft_consensus.cc:3055] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:58:04.989446 16167 raft_consensus.cc:740] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:58:04.990061 16167 consensus_queue.cc:260] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:04.990926 16167 raft_consensus.cc:3060] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:04.993534 16092 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 4.
I20260204 08:58:04.994396 15983 leader_election.cc:304] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36c8394a94a144008e367ff1b5299b8f, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:58:04.995074 16340 raft_consensus.cc:2804] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:58:04.995409 16340 raft_consensus.cc:697] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 4 LEADER]: Becoming Leader. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:04.995607 16167 raft_consensus.cc:2468] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36c8394a94a144008e367ff1b5299b8f in term 4.
I20260204 08:58:04.996251 16340 consensus_queue.cc:237] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:05.002537 15916 catalog_manager.cc:5654] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f reported cstate change: term changed from 3 to 4, leader changed from 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195) to 36c8394a94a144008e367ff1b5299b8f (127.15.3.193). New cstate: current_term: 4 leader_uuid: "36c8394a94a144008e367ff1b5299b8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:05.037151 16092 raft_consensus.cc:1275] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:58:05.038275 16340 consensus_queue.cc:1048] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:05.048290 16167 raft_consensus.cc:1275] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:58:05.050019 16349 consensus_queue.cc:1048] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:58:05.231062 16167 raft_consensus.cc:1275] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:05.232304 16349 consensus_queue.cc:1048] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:05.240511 16092 raft_consensus.cc:1275] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:05.242080 16349 consensus_queue.cc:1048] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:05.299829 16092 raft_consensus.cc:1275] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:05.300973 16349 consensus_queue.cc:1048] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:05.307372 16092 raft_consensus.cc:1275] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:05.307449 16167 raft_consensus.cc:1275] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:05.309092 16331 consensus_queue.cc:1048] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:05.309127 16349 consensus_queue.cc:1048] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:05.320329 16169 raft_consensus.cc:1275] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:05.321537 16331 consensus_queue.cc:1048] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:05.381434 16167 raft_consensus.cc:1275] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:58:05.382560 16331 consensus_queue.cc:1048] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:05.391242 16092 raft_consensus.cc:1275] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Refusing update from remote peer 36c8394a94a144008e367ff1b5299b8f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:58:05.393102 16348 consensus_queue.cc:1048] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:58:07.550756 15375 auto_leader_rebalancer-test.cc:377] The leader distribution is
I20260204 08:58:07.551301 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:07.558308 16020 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
mode: GRACEFUL
new_leader_uuid: "38797974ab14462a9e8860b3fb88ca21"
from {username='slave'} at 127.0.0.1:47464
I20260204 08:58:07.558735 16020 raft_consensus.cc:606] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Received request to transfer leadership to TS 38797974ab14462a9e8860b3fb88ca21
I20260204 08:58:07.561116 16020 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
mode: GRACEFUL
new_leader_uuid: "4e09378641cf441798c1a23f9cb2045f"
from {username='slave'} at 127.0.0.1:47464
I20260204 08:58:07.561581 16020 raft_consensus.cc:606] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Received request to transfer leadership to TS 4e09378641cf441798c1a23f9cb2045f
I20260204 08:58:07.563596 16020 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "550327a783cf412899cd30e7528153d4"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
mode: GRACEFUL
new_leader_uuid: "4e09378641cf441798c1a23f9cb2045f"
from {username='slave'} at 127.0.0.1:47464
I20260204 08:58:07.564030 16020 raft_consensus.cc:606] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Received request to transfer leadership to TS 4e09378641cf441798c1a23f9cb2045f
I20260204 08:58:07.565850 16020 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02"
dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
mode: GRACEFUL
new_leader_uuid: "38797974ab14462a9e8860b3fb88ca21"
from {username='slave'} at 127.0.0.1:47464
I20260204 08:58:07.566217 16020 raft_consensus.cc:606] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 3 LEADER]: Received request to transfer leadership to TS 38797974ab14462a9e8860b3fb88ca21
I20260204 08:58:07.567013 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260204 08:58:07.567443 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:07.698752 16365 raft_consensus.cc:993] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f: : Instructing follower 38797974ab14462a9e8860b3fb88ca21 to start an election
I20260204 08:58:07.699141 16349 raft_consensus.cc:1081] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 3 LEADER]: Signalling peer 38797974ab14462a9e8860b3fb88ca21 to start an election
I20260204 08:58:07.700254 16169 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
from {username='slave'} at 127.0.0.1:33072
I20260204 08:58:07.700659 16169 raft_consensus.cc:493] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:07.700899 16169 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:07.704849 16169 raft_consensus.cc:515] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:07.706416 16169 leader_election.cc:290] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 4 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:58:07.707135 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:58:07.707381 16092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0b0c5c3466a4b53911642d01b0bae02" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:58:07.707715 16020 raft_consensus.cc:3055] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:58:07.707896 16092 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:07.708021 16020 raft_consensus.cc:740] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:07.708725 16020 consensus_queue.cc:260] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:07.709793 16020 raft_consensus.cc:3060] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:07.714243 16092 raft_consensus.cc:2468] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 4.
I20260204 08:58:07.715435 16132 leader_election.cc:304] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:58:07.715490 16020 raft_consensus.cc:2468] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 4.
I20260204 08:58:07.716158 16339 raft_consensus.cc:2804] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:58:07.716984 16339 raft_consensus.cc:697] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 4 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:58:07.717722 16339 consensus_queue.cc:237] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:07.723354 15915 catalog_manager.cc:5654] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 3 to 4, leader changed from 36c8394a94a144008e367ff1b5299b8f (127.15.3.193) to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 4 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:07.859563 16365 raft_consensus.cc:993] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f: : Instructing follower 38797974ab14462a9e8860b3fb88ca21 to start an election
I20260204 08:58:07.860003 16349 raft_consensus.cc:1081] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Signalling peer 38797974ab14462a9e8860b3fb88ca21 to start an election
I20260204 08:58:07.861236 16169 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9"
dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
from {username='slave'} at 127.0.0.1:33072
I20260204 08:58:07.861675 16169 raft_consensus.cc:493] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:07.861907 16169 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:07.865983 16169 raft_consensus.cc:515] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:07.867312 16169 leader_election.cc:290] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 3 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127)
I20260204 08:58:07.868232 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:58:07.868355 16092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14799dac72254241bd373b62e4f2d2d9" candidate_uuid: "38797974ab14462a9e8860b3fb88ca21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
I20260204 08:58:07.868691 16020 raft_consensus.cc:3055] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:07.868924 16092 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:07.868939 16020 raft_consensus.cc:740] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:07.869807 16020 consensus_queue.cc:260] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:07.870646 16020 raft_consensus.cc:3060] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:07.874476 16092 raft_consensus.cc:2468] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 3.
I20260204 08:58:07.875451 16132 leader_election.cc:304] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:58:07.875577 16020 raft_consensus.cc:2468] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38797974ab14462a9e8860b3fb88ca21 in term 3.
I20260204 08:58:07.876164 16339 raft_consensus.cc:2804] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:07.876631 16339 raft_consensus.cc:697] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Becoming Leader. State: Replica: 38797974ab14462a9e8860b3fb88ca21, State: Running, Role: LEADER
I20260204 08:58:07.877292 16339 consensus_queue.cc:237] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:07.884132 15915 catalog_manager.cc:5654] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 reported cstate change: term changed from 2 to 3, leader changed from 36c8394a94a144008e367ff1b5299b8f (127.15.3.193) to 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "38797974ab14462a9e8860b3fb88ca21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:08.113050 16365 raft_consensus.cc:993] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f: : Instructing follower 4e09378641cf441798c1a23f9cb2045f to start an election
I20260204 08:58:08.113458 16349 raft_consensus.cc:1081] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Signalling peer 4e09378641cf441798c1a23f9cb2045f to start an election
I20260204 08:58:08.114818 16092 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "550327a783cf412899cd30e7528153d4"
dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
from {username='slave'} at 127.0.0.1:43302
I20260204 08:58:08.115312 16092 raft_consensus.cc:493] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:08.115590 16092 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:08.120023 16092 raft_consensus.cc:515] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:08.121869 16092 leader_election.cc:290] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 3 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:58:08.122668 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "550327a783cf412899cd30e7528153d4" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:58:08.122716 16169 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "550327a783cf412899cd30e7528153d4" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:58:08.123235 16020 raft_consensus.cc:3055] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:08.123306 16169 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:08.123487 16020 raft_consensus.cc:740] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:08.124110 16020 consensus_queue.cc:260] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:08.124909 16020 raft_consensus.cc:3060] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:08.127310 16169 raft_consensus.cc:2468] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 3.
I20260204 08:58:08.128291 16059 leader_election.cc:304] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:58:08.128863 16322 raft_consensus.cc:2804] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:08.129011 16020 raft_consensus.cc:2468] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 3.
I20260204 08:58:08.129904 16322 raft_consensus.cc:697] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 3 LEADER]: Becoming Leader. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:58:08.130563 16322 consensus_queue.cc:237] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:08.136905 15915 catalog_manager.cc:5654] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f reported cstate change: term changed from 2 to 3, leader changed from 36c8394a94a144008e367ff1b5299b8f (127.15.3.193) to 4e09378641cf441798c1a23f9cb2045f (127.15.3.194). New cstate: current_term: 3 leader_uuid: "4e09378641cf441798c1a23f9cb2045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:08.151420 16365 raft_consensus.cc:993] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f: : Instructing follower 4e09378641cf441798c1a23f9cb2045f to start an election
I20260204 08:58:08.151863 16375 raft_consensus.cc:1081] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Signalling peer 4e09378641cf441798c1a23f9cb2045f to start an election
I20260204 08:58:08.153139 16092 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83"
dest_uuid: "4e09378641cf441798c1a23f9cb2045f"
from {username='slave'} at 127.0.0.1:43302
I20260204 08:58:08.153580 16092 raft_consensus.cc:493] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:08.153851 16092 raft_consensus.cc:3060] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:08.158829 16092 raft_consensus.cc:515] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:08.160324 16092 leader_election.cc:290] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 2 election: Requested vote from peers 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929), 38797974ab14462a9e8860b3fb88ca21 (127.15.3.195:33753)
I20260204 08:58:08.161129 16020 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36c8394a94a144008e367ff1b5299b8f"
I20260204 08:58:08.161222 16169 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4aacec7256b84e748e4c563bdbda0f83" candidate_uuid: "4e09378641cf441798c1a23f9cb2045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38797974ab14462a9e8860b3fb88ca21"
I20260204 08:58:08.161650 16020 raft_consensus.cc:3055] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:08.161752 16169 raft_consensus.cc:3060] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:08.161943 16020 raft_consensus.cc:740] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36c8394a94a144008e367ff1b5299b8f, State: Running, Role: LEADER
I20260204 08:58:08.162523 16020 consensus_queue.cc:260] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:08.163323 16020 raft_consensus.cc:3060] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:08.166379 16169 raft_consensus.cc:2468] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 2.
I20260204 08:58:08.167284 16059 leader_election.cc:304] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38797974ab14462a9e8860b3fb88ca21, 4e09378641cf441798c1a23f9cb2045f; no voters:
I20260204 08:58:08.167301 16020 raft_consensus.cc:2468] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e09378641cf441798c1a23f9cb2045f in term 2.
I20260204 08:58:08.168143 16373 raft_consensus.cc:2804] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:08.168634 16373 raft_consensus.cc:697] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Becoming Leader. State: Replica: 4e09378641cf441798c1a23f9cb2045f, State: Running, Role: LEADER
I20260204 08:58:08.169447 16373 consensus_queue.cc:237] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } }
I20260204 08:58:08.175531 15915 catalog_manager.cc:5654] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f reported cstate change: term changed from 1 to 2, leader changed from 36c8394a94a144008e367ff1b5299b8f (127.15.3.193) to 4e09378641cf441798c1a23f9cb2045f (127.15.3.194). New cstate: current_term: 2 leader_uuid: "4e09378641cf441798c1a23f9cb2045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:08.257190 16020 raft_consensus.cc:1275] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Refusing update from remote peer 38797974ab14462a9e8860b3fb88ca21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:58:08.258177 16339 consensus_queue.cc:1048] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:08.267159 16092 raft_consensus.cc:1275] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Refusing update from remote peer 38797974ab14462a9e8860b3fb88ca21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:58:08.268452 16339 consensus_queue.cc:1048] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:08.345821 16092 raft_consensus.cc:1275] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Refusing update from remote peer 38797974ab14462a9e8860b3fb88ca21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:08.346999 16339 consensus_queue.cc:1048] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e09378641cf441798c1a23f9cb2045f" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 34127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:08.355535 16020 raft_consensus.cc:1275] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Refusing update from remote peer 38797974ab14462a9e8860b3fb88ca21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:08.357689 16366 consensus_queue.cc:1048] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:08.525163 16169 raft_consensus.cc:1275] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Refusing update from remote peer 4e09378641cf441798c1a23f9cb2045f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:08.526227 16373 consensus_queue.cc:1048] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:08.534792 16020 raft_consensus.cc:1275] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Refusing update from remote peer 4e09378641cf441798c1a23f9cb2045f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:08.536088 16387 consensus_queue.cc:1048] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:08.568284 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:08.573660 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:08.574048 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:08.699416 16169 raft_consensus.cc:1275] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Refusing update from remote peer 4e09378641cf441798c1a23f9cb2045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:08.701013 16387 consensus_queue.cc:1048] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "38797974ab14462a9e8860b3fb88ca21" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:08.704296 16020 raft_consensus.cc:1275] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Refusing update from remote peer 4e09378641cf441798c1a23f9cb2045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:08.705842 16387 consensus_queue.cc:1048] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36c8394a94a144008e367ff1b5299b8f" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:09.574934 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:09.580498 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:09.580938 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:10.581931 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:10.587375 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:10.587778 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:11.588558 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:11.593673 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:11.594122 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:12.594983 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:12.600214 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:12.600598 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:13.601379 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:13.606467 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:13.606861 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:14.607677 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:14.612877 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:14.613323 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:15.614217 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:15.619410 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:15.619843 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:16.620623 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:16.625768 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:58:16.626166 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:17.653972 15375 auto_leader_rebalancer-test.cc:388] The leader distribution is
I20260204 08:58:17.654438 15375 tablet_server.cc:178] TabletServer@127.15.3.193:0 shutting down...
I20260204 08:58:17.683630 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:58:17.684337 15375 tablet_replica.cc:333] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.684911 15375 raft_consensus.cc:2243] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 4 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.685714 15375 raft_consensus.cc:2272] T dfca7b772ba84fe78bc563ef42ed1e29 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.687573 15375 tablet_replica.cc:333] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.688095 15375 raft_consensus.cc:2243] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.688495 15375 raft_consensus.cc:2272] T 2e420edb8ea848e586ab02e701a5182d P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.690207 15375 tablet_replica.cc:333] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.690665 15375 raft_consensus.cc:2243] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.691113 15375 raft_consensus.cc:2272] T 5f7373c9ec18444186d4f63994370b20 P 36c8394a94a144008e367ff1b5299b8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.693477 15375 tablet_replica.cc:333] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.694144 15375 raft_consensus.cc:2243] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.694516 15375 raft_consensus.cc:2272] T c0b0c5c3466a4b53911642d01b0bae02 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.696054 15375 tablet_replica.cc:333] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.696496 15375 raft_consensus.cc:2243] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.696835 15375 raft_consensus.cc:2272] T 4aacec7256b84e748e4c563bdbda0f83 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.698320 15375 tablet_replica.cc:333] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.698788 15375 raft_consensus.cc:2243] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.699488 15375 raft_consensus.cc:2272] T 5814881258624395bdc971cdc86ae91c P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.701088 15375 tablet_replica.cc:333] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.701516 15375 raft_consensus.cc:2243] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.701867 15375 raft_consensus.cc:2272] T 14799dac72254241bd373b62e4f2d2d9 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.703323 15375 tablet_replica.cc:333] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.703788 15375 raft_consensus.cc:2243] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 4 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.704490 15375 raft_consensus.cc:2272] T e78a64d5fcb141929ebf131180e5f8f0 P 36c8394a94a144008e367ff1b5299b8f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.706084 15375 tablet_replica.cc:333] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.706502 15375 raft_consensus.cc:2243] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.707162 15375 raft_consensus.cc:2272] T 5226181817d0491aa3569913ff102789 P 36c8394a94a144008e367ff1b5299b8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.708739 15375 tablet_replica.cc:333] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f: stopping tablet replica
I20260204 08:58:17.709128 15375 raft_consensus.cc:2243] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.709479 15375 raft_consensus.cc:2272] T 550327a783cf412899cd30e7528153d4 P 36c8394a94a144008e367ff1b5299b8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.755795 15375 tablet_server.cc:195] TabletServer@127.15.3.193:0 shutdown complete.
W20260204 08:58:17.769381 16134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.3.193:44929: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260204 08:58:17.772982 16134 consensus_peers.cc:597] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 -> Peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Couldn't send request to peer 36c8394a94a144008e367ff1b5299b8f. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:17.777184 15375 tablet_server.cc:178] TabletServer@127.15.3.194:0 shutting down...
W20260204 08:58:17.784545 16060 consensus_peers.cc:597] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f -> Peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Couldn't send request to peer 36c8394a94a144008e367ff1b5299b8f. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:58:17.801002 16060 consensus_peers.cc:597] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f -> Peer 36c8394a94a144008e367ff1b5299b8f (127.15.3.193:44929): Couldn't send request to peer 36c8394a94a144008e367ff1b5299b8f. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:17.804469 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:58:17.805102 15375 tablet_replica.cc:333] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.805840 15375 raft_consensus.cc:2243] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.806416 15375 raft_consensus.cc:2272] T 5f7373c9ec18444186d4f63994370b20 P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.808218 15375 tablet_replica.cc:333] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.808698 15375 raft_consensus.cc:2243] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.809072 15375 raft_consensus.cc:2272] T e78a64d5fcb141929ebf131180e5f8f0 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.810542 15375 tablet_replica.cc:333] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.810974 15375 raft_consensus.cc:2243] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.811298 15375 raft_consensus.cc:2272] T 5226181817d0491aa3569913ff102789 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.812912 15375 tablet_replica.cc:333] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.813335 15375 raft_consensus.cc:2243] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.813750 15375 raft_consensus.cc:2272] T 14799dac72254241bd373b62e4f2d2d9 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.815280 15375 tablet_replica.cc:333] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.815753 15375 raft_consensus.cc:2243] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.816131 15375 raft_consensus.cc:2272] T dfca7b772ba84fe78bc563ef42ed1e29 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.817720 15375 tablet_replica.cc:333] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.818159 15375 raft_consensus.cc:2243] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.818799 15375 raft_consensus.cc:2272] T 550327a783cf412899cd30e7528153d4 P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.820545 15375 tablet_replica.cc:333] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.821024 15375 raft_consensus.cc:2243] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.821390 15375 raft_consensus.cc:2272] T 5814881258624395bdc971cdc86ae91c P 4e09378641cf441798c1a23f9cb2045f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.823174 15375 tablet_replica.cc:333] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.823623 15375 raft_consensus.cc:2243] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.824276 15375 raft_consensus.cc:2272] T 4aacec7256b84e748e4c563bdbda0f83 P 4e09378641cf441798c1a23f9cb2045f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.825856 15375 tablet_replica.cc:333] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.826282 15375 raft_consensus.cc:2243] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.826665 15375 raft_consensus.cc:2272] T c0b0c5c3466a4b53911642d01b0bae02 P 4e09378641cf441798c1a23f9cb2045f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.828253 15375 tablet_replica.cc:333] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f: stopping tablet replica
I20260204 08:58:17.828696 15375 raft_consensus.cc:2243] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.829463 15375 raft_consensus.cc:2272] T 2e420edb8ea848e586ab02e701a5182d P 4e09378641cf441798c1a23f9cb2045f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.856088 15375 tablet_server.cc:195] TabletServer@127.15.3.194:0 shutdown complete.
I20260204 08:58:17.875059 15375 tablet_server.cc:178] TabletServer@127.15.3.195:0 shutting down...
W20260204 08:58:17.876739 16132 consensus_peers.cc:597] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 -> Peer 4e09378641cf441798c1a23f9cb2045f (127.15.3.194:34127): Couldn't send request to peer 4e09378641cf441798c1a23f9cb2045f. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:34127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:17.894590 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:58:17.895190 15375 tablet_replica.cc:333] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.895819 15375 raft_consensus.cc:2243] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.896268 15375 raft_consensus.cc:2272] T 5226181817d0491aa3569913ff102789 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.897969 15375 tablet_replica.cc:333] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.898442 15375 raft_consensus.cc:2243] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.898845 15375 raft_consensus.cc:2272] T e78a64d5fcb141929ebf131180e5f8f0 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.900504 15375 tablet_replica.cc:333] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.900979 15375 raft_consensus.cc:2243] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.901337 15375 raft_consensus.cc:2272] T dfca7b772ba84fe78bc563ef42ed1e29 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.902962 15375 tablet_replica.cc:333] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.903385 15375 raft_consensus.cc:2243] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.903779 15375 raft_consensus.cc:2272] T 2e420edb8ea848e586ab02e701a5182d P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.905342 15375 tablet_replica.cc:333] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.905860 15375 raft_consensus.cc:2243] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.906574 15375 raft_consensus.cc:2272] T 5f7373c9ec18444186d4f63994370b20 P 38797974ab14462a9e8860b3fb88ca21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.908218 15375 tablet_replica.cc:333] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.908671 15375 raft_consensus.cc:2243] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.909050 15375 raft_consensus.cc:2272] T 550327a783cf412899cd30e7528153d4 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.910516 15375 tablet_replica.cc:333] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.910960 15375 raft_consensus.cc:2243] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 4 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.911754 15375 raft_consensus.cc:2272] T c0b0c5c3466a4b53911642d01b0bae02 P 38797974ab14462a9e8860b3fb88ca21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.913403 15375 tablet_replica.cc:333] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.913849 15375 raft_consensus.cc:2243] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.914220 15375 raft_consensus.cc:2272] T 4aacec7256b84e748e4c563bdbda0f83 P 38797974ab14462a9e8860b3fb88ca21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.915686 15375 tablet_replica.cc:333] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.916116 15375 raft_consensus.cc:2243] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:17.916519 15375 raft_consensus.cc:2272] T 5814881258624395bdc971cdc86ae91c P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.918087 15375 tablet_replica.cc:333] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21: stopping tablet replica
I20260204 08:58:17.918483 15375 raft_consensus.cc:2243] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.919113 15375 raft_consensus.cc:2272] T 14799dac72254241bd373b62e4f2d2d9 P 38797974ab14462a9e8860b3fb88ca21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.946218 15375 tablet_server.cc:195] TabletServer@127.15.3.195:0 shutdown complete.
I20260204 08:58:17.964205 15375 master.cc:561] Master@127.15.3.254:40951 shutting down...
I20260204 08:58:17.982443 15375 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:58:17.983101 15375 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:17.983527 15375 tablet_replica.cc:333] T 00000000000000000000000000000000 P a860de6df1bf44b988affe64804630f6: stopping tablet replica
I20260204 08:58:18.002862 15375 master.cc:583] Master@127.15.3.254:40951 shutdown complete.
36c8394a94a144008e367ff1b5299b8f 5
38797974ab14462a9e8860b3fb88ca21 1
4e09378641cf441798c1a23f9cb2045f 4
36c8394a94a144008e367ff1b5299b8f 3
38797974ab14462a9e8860b3fb88ca21 3
4e09378641cf441798c1a23f9cb2045f 4
36c8394a94a144008e367ff1b5299b8f 8
38797974ab14462a9e8860b3fb88ca21 1
4e09378641cf441798c1a23f9cb2045f 1
36c8394a94a144008e367ff1b5299b8f 4
38797974ab14462a9e8860b3fb88ca21 3
4e09378641cf441798c1a23f9cb2045f 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28773 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260204 08:58:18.039286 15375 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.3.254:45355
I20260204 08:58:18.040426 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:58:18.046032 16405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:18.052132 16406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:18.052556 16408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:58:18.053484 15375 server_base.cc:1060] running on GCE node
I20260204 08:58:18.054340 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:58:18.054522 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:58:18.054641 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195498054629 us; error 0 us; skew 500 ppm
I20260204 08:58:18.055096 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:58:18.057448 15375 webserver.cc:492] Webserver started at http://127.15.3.254:35831/ using document root <none> and password file <none>
I20260204 08:58:18.057878 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:58:18.058036 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:58:18.058243 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:58:18.059311 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/master-0-root/instance:
uuid: "3b7553c320c44328a698b00435cfe869"
format_stamp: "Formatted at 2026-02-04 08:58:18 on dist-test-slave-3tf0"
I20260204 08:58:18.063683 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s
I20260204 08:58:18.067029 16413 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.067771 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260204 08:58:18.068068 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/master-0-root
uuid: "3b7553c320c44328a698b00435cfe869"
format_stamp: "Formatted at 2026-02-04 08:58:18 on dist-test-slave-3tf0"
I20260204 08:58:18.068328 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:58:18.097630 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:58:18.098819 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:58:18.134598 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.254:45355
I20260204 08:58:18.134734 16464 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.254:45355 every 8 connection(s)
I20260204 08:58:18.138332 16465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.148550 16465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869: Bootstrap starting.
I20260204 08:58:18.152917 16465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:18.156913 16465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869: No bootstrap required, opened a new log
I20260204 08:58:18.158814 16465 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7553c320c44328a698b00435cfe869" member_type: VOTER }
I20260204 08:58:18.159169 16465 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:18.159340 16465 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7553c320c44328a698b00435cfe869, State: Initialized, Role: FOLLOWER
I20260204 08:58:18.159807 16465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7553c320c44328a698b00435cfe869" member_type: VOTER }
I20260204 08:58:18.160189 16465 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 08:58:18.160367 16465 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 08:58:18.160578 16465 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:18.164446 16465 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7553c320c44328a698b00435cfe869" member_type: VOTER }
I20260204 08:58:18.164891 16465 leader_election.cc:304] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b7553c320c44328a698b00435cfe869; no voters:
I20260204 08:58:18.165917 16465 leader_election.cc:290] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 08:58:18.166265 16468 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:18.167426 16468 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 1 LEADER]: Becoming Leader. State: Replica: 3b7553c320c44328a698b00435cfe869, State: Running, Role: LEADER
I20260204 08:58:18.168107 16468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7553c320c44328a698b00435cfe869" member_type: VOTER }
I20260204 08:58:18.168768 16465 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [sys.catalog]: configured and running, proceeding with master startup.
I20260204 08:58:18.172271 16470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b7553c320c44328a698b00435cfe869. Latest consensus state: current_term: 1 leader_uuid: "3b7553c320c44328a698b00435cfe869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7553c320c44328a698b00435cfe869" member_type: VOTER } }
I20260204 08:58:18.172911 16470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [sys.catalog]: This master's current role is: LEADER
I20260204 08:58:18.172870 16469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b7553c320c44328a698b00435cfe869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7553c320c44328a698b00435cfe869" member_type: VOTER } }
I20260204 08:58:18.173507 16469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [sys.catalog]: This master's current role is: LEADER
I20260204 08:58:18.174818 16475 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 08:58:18.180600 16475 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 08:58:18.182775 15375 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 08:58:18.188553 16475 catalog_manager.cc:1357] Generated new cluster ID: 23b974a7599d4d13b18ae46cba2b1213
I20260204 08:58:18.188827 16475 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 08:58:18.200474 16475 catalog_manager.cc:1380] Generated new certificate authority record
I20260204 08:58:18.201697 16475 catalog_manager.cc:1514] Loading token signing keys...
I20260204 08:58:18.213917 16475 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869: Generated new TSK 0
I20260204 08:58:18.214499 16475 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 08:58:18.249586 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:58:18.255779 16486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:18.256479 16487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:58:18.264123 15375 server_base.cc:1060] running on GCE node
W20260204 08:58:18.264070 16489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:58:18.265297 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:58:18.265491 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:58:18.265667 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195498265643 us; error 0 us; skew 500 ppm
I20260204 08:58:18.266130 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:58:18.268416 15375 webserver.cc:492] Webserver started at http://127.15.3.193:43187/ using document root <none> and password file <none>
I20260204 08:58:18.268850 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:58:18.269097 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:58:18.269421 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:58:18.270983 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/instance:
uuid: "35380a227e2c4fa4a063d4fd67c30b53"
format_stamp: "Formatted at 2026-02-04 08:58:18 on dist-test-slave-3tf0"
I20260204 08:58:18.276842 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260204 08:58:18.280432 16494 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.281144 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260204 08:58:18.281394 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
uuid: "35380a227e2c4fa4a063d4fd67c30b53"
format_stamp: "Formatted at 2026-02-04 08:58:18 on dist-test-slave-3tf0"
I20260204 08:58:18.281647 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:58:18.309423 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:58:18.310598 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:58:18.312002 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:58:18.314155 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:58:18.314340 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.314556 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:58:18.314710 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.351780 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.193:39621
I20260204 08:58:18.351933 16556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.193:39621 every 8 connection(s)
I20260204 08:58:18.356014 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:58:18.362798 16561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:18.364934 16562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:18.365818 16564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:58:18.366115 15375 server_base.cc:1060] running on GCE node
I20260204 08:58:18.367481 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:58:18.367707 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:58:18.367874 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195498367856 us; error 0 us; skew 500 ppm
I20260204 08:58:18.368472 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:58:18.369585 16557 heartbeater.cc:344] Connected to a master server at 127.15.3.254:45355
I20260204 08:58:18.369989 16557 heartbeater.cc:461] Registering TS with master...
I20260204 08:58:18.370712 16557 heartbeater.cc:507] Master 127.15.3.254:45355 requested a full tablet report, sending...
I20260204 08:58:18.371157 15375 webserver.cc:492] Webserver started at http://127.15.3.194:45847/ using document root <none> and password file <none>
I20260204 08:58:18.371629 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:58:18.371847 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:58:18.372164 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:58:18.372884 16430 ts_manager.cc:194] Registered new tserver with Master: 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:18.373330 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/instance:
uuid: "f959652a42f34a81aca5da9faec0a7a3"
format_stamp: "Formatted at 2026-02-04 08:58:18 on dist-test-slave-3tf0"
I20260204 08:58:18.374598 16430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45048
I20260204 08:58:18.377698 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260204 08:58:18.380923 16569 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.381606 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260204 08:58:18.381875 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root
uuid: "f959652a42f34a81aca5da9faec0a7a3"
format_stamp: "Formatted at 2026-02-04 08:58:18 on dist-test-slave-3tf0"
I20260204 08:58:18.382136 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:58:18.403218 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:58:18.404429 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:58:18.405866 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:58:18.408181 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:58:18.408394 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.408623 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:58:18.408773 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.445538 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.194:42667
I20260204 08:58:18.445636 16631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.194:42667 every 8 connection(s)
I20260204 08:58:18.449931 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:58:18.456413 16635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:18.457120 16636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:18.458948 16638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:58:18.459704 15375 server_base.cc:1060] running on GCE node
I20260204 08:58:18.460505 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:58:18.460806 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:58:18.460983 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195498460964 us; error 0 us; skew 500 ppm
I20260204 08:58:18.461616 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:58:18.461747 16632 heartbeater.cc:344] Connected to a master server at 127.15.3.254:45355
I20260204 08:58:18.462082 16632 heartbeater.cc:461] Registering TS with master...
I20260204 08:58:18.462885 16632 heartbeater.cc:507] Master 127.15.3.254:45355 requested a full tablet report, sending...
I20260204 08:58:18.463936 15375 webserver.cc:492] Webserver started at http://127.15.3.195:39875/ using document root <none> and password file <none>
I20260204 08:58:18.464395 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:58:18.464571 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:58:18.464677 16430 ts_manager.cc:194] Registered new tserver with Master: f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:18.464803 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:58:18.465936 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/instance:
uuid: "86e16045049f4f87a94336b5d2262328"
format_stamp: "Formatted at 2026-02-04 08:58:18 on dist-test-slave-3tf0"
I20260204 08:58:18.465989 16430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45054
I20260204 08:58:18.470315 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260204 08:58:18.473464 16643 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.474109 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260204 08:58:18.474365 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root
uuid: "86e16045049f4f87a94336b5d2262328"
format_stamp: "Formatted at 2026-02-04 08:58:18 on dist-test-slave-3tf0"
I20260204 08:58:18.474632 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:58:18.489898 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:58:18.491036 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:58:18.492450 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:58:18.494490 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:58:18.494688 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.494902 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:58:18.495050 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:18.531805 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.195:39491
I20260204 08:58:18.531901 16705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.195:39491 every 8 connection(s)
I20260204 08:58:18.544011 16706 heartbeater.cc:344] Connected to a master server at 127.15.3.254:45355
I20260204 08:58:18.544361 16706 heartbeater.cc:461] Registering TS with master...
I20260204 08:58:18.545043 16706 heartbeater.cc:507] Master 127.15.3.254:45355 requested a full tablet report, sending...
I20260204 08:58:18.546756 16430 ts_manager.cc:194] Registered new tserver with Master: 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:18.546869 15375 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012219441s
I20260204 08:58:18.548455 16430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45056
I20260204 08:58:18.570955 16430 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45070:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260204 08:58:18.577122 16430 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260204 08:58:18.810101 16670 tablet_service.cc:1505] Processing CreateTablet for tablet 376fb0bb77c04a0d9daf4939af20207f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260204 08:58:18.813046 16597 tablet_service.cc:1505] Processing CreateTablet for tablet 795715e8aaa1450e811ecebf022fd69b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260204 08:58:18.814687 16597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795715e8aaa1450e811ecebf022fd69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.814383 16668 tablet_service.cc:1505] Processing CreateTablet for tablet d8c54bb34a3c42489cc93960f1717406 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260204 08:58:18.815568 16522 tablet_service.cc:1505] Processing CreateTablet for tablet 795715e8aaa1450e811ecebf022fd69b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260204 08:58:18.817024 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795715e8aaa1450e811ecebf022fd69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.816900 16596 tablet_service.cc:1505] Processing CreateTablet for tablet 376fb0bb77c04a0d9daf4939af20207f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260204 08:58:18.818248 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376fb0bb77c04a0d9daf4939af20207f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.818082 16666 tablet_service.cc:1505] Processing CreateTablet for tablet 4773c29a00ab47f9b55fd479ace200e7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260204 08:58:18.819433 16666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4773c29a00ab47f9b55fd479ace200e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.820922 16665 tablet_service.cc:1505] Processing CreateTablet for tablet 0081bf9327d5467897615fd29a2a5ad6 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260204 08:58:18.821193 16595 tablet_service.cc:1505] Processing CreateTablet for tablet 0d2622edd6954367a260d3600443dd26 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260204 08:58:18.822466 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2622edd6954367a260d3600443dd26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.822141 16513 tablet_service.cc:1505] Processing CreateTablet for tablet 6a1d2d7d1f3440c48f319087b6e44ee0 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260204 08:58:18.823393 16513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1d2d7d1f3440c48f319087b6e44ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.823199 16521 tablet_service.cc:1505] Processing CreateTablet for tablet 376fb0bb77c04a0d9daf4939af20207f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260204 08:58:18.824832 16594 tablet_service.cc:1505] Processing CreateTablet for tablet d8c54bb34a3c42489cc93960f1717406 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260204 08:58:18.825603 16520 tablet_service.cc:1505] Processing CreateTablet for tablet 0d2622edd6954367a260d3600443dd26 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260204 08:58:18.826097 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c54bb34a3c42489cc93960f1717406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.827986 16519 tablet_service.cc:1505] Processing CreateTablet for tablet d8c54bb34a3c42489cc93960f1717406 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260204 08:58:18.828814 16592 tablet_service.cc:1505] Processing CreateTablet for tablet 4773c29a00ab47f9b55fd479ace200e7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260204 08:58:18.830109 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4773c29a00ab47f9b55fd479ace200e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.830288 16518 tablet_service.cc:1505] Processing CreateTablet for tablet af129226cb2f41479ef5eb75771c860b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260204 08:58:18.832638 16517 tablet_service.cc:1505] Processing CreateTablet for tablet 4773c29a00ab47f9b55fd479ace200e7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260204 08:58:18.834827 16516 tablet_service.cc:1505] Processing CreateTablet for tablet 0081bf9327d5467897615fd29a2a5ad6 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260204 08:58:18.836881 16591 tablet_service.cc:1505] Processing CreateTablet for tablet 0081bf9327d5467897615fd29a2a5ad6 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260204 08:58:18.837025 16515 tablet_service.cc:1505] Processing CreateTablet for tablet 3c7e1fed9cf44fa0b10d749e42e6d702 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260204 08:58:18.838137 16591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0081bf9327d5467897615fd29a2a5ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.839257 16514 tablet_service.cc:1505] Processing CreateTablet for tablet 12675d44700947d9871774efc58a8b70 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260204 08:58:18.841288 16590 tablet_service.cc:1505] Processing CreateTablet for tablet 3c7e1fed9cf44fa0b10d749e42e6d702 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260204 08:58:18.842519 16590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7e1fed9cf44fa0b10d749e42e6d702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.843276 16664 tablet_service.cc:1505] Processing CreateTablet for tablet 3c7e1fed9cf44fa0b10d749e42e6d702 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260204 08:58:18.845280 16589 tablet_service.cc:1505] Processing CreateTablet for tablet 12675d44700947d9871774efc58a8b70 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260204 08:58:18.846086 16663 tablet_service.cc:1505] Processing CreateTablet for tablet 12675d44700947d9871774efc58a8b70 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260204 08:58:18.820924 16593 tablet_service.cc:1505] Processing CreateTablet for tablet af129226cb2f41479ef5eb75771c860b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260204 08:58:18.812983 16669 tablet_service.cc:1505] Processing CreateTablet for tablet 0d2622edd6954367a260d3600443dd26 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260204 08:58:18.847456 16662 tablet_service.cc:1505] Processing CreateTablet for tablet 6a1d2d7d1f3440c48f319087b6e44ee0 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260204 08:58:18.807555 16671 tablet_service.cc:1505] Processing CreateTablet for tablet 795715e8aaa1450e811ecebf022fd69b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260204 08:58:18.849774 16521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376fb0bb77c04a0d9daf4939af20207f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.850371 16588 tablet_service.cc:1505] Processing CreateTablet for tablet 6a1d2d7d1f3440c48f319087b6e44ee0 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260204 08:58:18.852527 16588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1d2d7d1f3440c48f319087b6e44ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.855504 16522 tablet_service.cc:1505] Processing CreateTablet for tablet 6e3200a486ed4e50b8cd3fbace254888 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260204 08:58:18.856465 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12675d44700947d9871774efc58a8b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.857344 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af129226cb2f41479ef5eb75771c860b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.859758 16722 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:18.816913 16667 tablet_service.cc:1505] Processing CreateTablet for tablet af129226cb2f41479ef5eb75771c860b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260204 08:58:18.855952 16515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7e1fed9cf44fa0b10d749e42e6d702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.868044 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2622edd6954367a260d3600443dd26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.871665 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4773c29a00ab47f9b55fd479ace200e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.875998 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c54bb34a3c42489cc93960f1717406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.879197 16723 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:18.880028 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af129226cb2f41479ef5eb75771c860b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.880887 16668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c54bb34a3c42489cc93960f1717406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.880983 16589 tablet_service.cc:1505] Processing CreateTablet for tablet 6e3200a486ed4e50b8cd3fbace254888 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260204 08:58:18.882220 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376fb0bb77c04a0d9daf4939af20207f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.883667 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795715e8aaa1450e811ecebf022fd69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.884075 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3200a486ed4e50b8cd3fbace254888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.888010 16514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12675d44700947d9871774efc58a8b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.884958 16513 tablet_service.cc:1505] Processing CreateTablet for tablet 232077fdd4b44876ba13c53b7f42f888 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260204 08:58:18.886011 16664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7e1fed9cf44fa0b10d749e42e6d702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.889056 16513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232077fdd4b44876ba13c53b7f42f888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.889206 16663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12675d44700947d9871774efc58a8b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.891966 16667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af129226cb2f41479ef5eb75771c860b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.894207 16669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2622edd6954367a260d3600443dd26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.895820 16665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0081bf9327d5467897615fd29a2a5ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.899987 16662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1d2d7d1f3440c48f319087b6e44ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.904176 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0081bf9327d5467897615fd29a2a5ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.912184 16588 tablet_service.cc:1505] Processing CreateTablet for tablet 232077fdd4b44876ba13c53b7f42f888 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260204 08:58:18.913501 16588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232077fdd4b44876ba13c53b7f42f888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.926036 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3200a486ed4e50b8cd3fbace254888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.938912 16722 tablet_bootstrap.cc:654] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:18.941709 16723 tablet_bootstrap.cc:654] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:18.959328 16518 tablet_service.cc:1505] Processing CreateTablet for tablet 147ea8d1b63e4e9e8f084676f3f0ea12 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260204 08:58:18.968398 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147ea8d1b63e4e9e8f084676f3f0ea12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.971328 16514 tablet_service.cc:1505] Processing CreateTablet for tablet 4d0dd5730ea04490876711f04afa95e5 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260204 08:58:18.972658 16514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0dd5730ea04490876711f04afa95e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:18.990221 16664 tablet_service.cc:1505] Processing CreateTablet for tablet 4bff71b9804b47cc915e34b23012509e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260204 08:58:18.993320 16668 tablet_service.cc:1505] Processing CreateTablet for tablet deb06db695bc4cd7bcef0b6d5f27c3e3 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260204 08:58:19.012274 16597 tablet_service.cc:1505] Processing CreateTablet for tablet 147ea8d1b63e4e9e8f084676f3f0ea12 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260204 08:58:19.013600 16597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147ea8d1b63e4e9e8f084676f3f0ea12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.013978 16513 tablet_service.cc:1505] Processing CreateTablet for tablet 0f175f5811e74a91b26e6ac39bc9d0b7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260204 08:58:19.014566 16722 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:19.015070 16722 ts_tablet_manager.cc:1403] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.156s user 0.008s sys 0.009s
I20260204 08:58:19.016723 16590 tablet_service.cc:1505] Processing CreateTablet for tablet 0f175f5811e74a91b26e6ac39bc9d0b7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260204 08:58:19.017921 16590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f175f5811e74a91b26e6ac39bc9d0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.018666 16664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bff71b9804b47cc915e34b23012509e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.021317 16665 tablet_service.cc:1505] Processing CreateTablet for tablet 232077fdd4b44876ba13c53b7f42f888 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260204 08:58:19.022521 16665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232077fdd4b44876ba13c53b7f42f888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.025020 16592 tablet_service.cc:1505] Processing CreateTablet for tablet 61ec06ad82864d3a91228c325fd1af2d (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260204 08:58:19.026221 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ec06ad82864d3a91228c325fd1af2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.027942 16513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f175f5811e74a91b26e6ac39bc9d0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.030570 16588 tablet_service.cc:1505] Processing CreateTablet for tablet 29067ae5902a405283277bb95a626f04 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260204 08:58:19.036383 16588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29067ae5902a405283277bb95a626f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.013201 16596 tablet_service.cc:1505] Processing CreateTablet for tablet 4d0dd5730ea04490876711f04afa95e5 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260204 08:58:19.031833 16668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb06db695bc4cd7bcef0b6d5f27c3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.027559 16722 raft_consensus.cc:359] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.037326 16516 tablet_service.cc:1505] Processing CreateTablet for tablet 61ec06ad82864d3a91228c325fd1af2d (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260204 08:58:19.037715 16591 tablet_service.cc:1505] Processing CreateTablet for tablet 72c4736a5d244206a366cb1166df369e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260204 08:58:19.017714 16666 tablet_service.cc:1505] Processing CreateTablet for tablet 6e3200a486ed4e50b8cd3fbace254888 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260204 08:58:19.040182 16595 tablet_service.cc:1505] Processing CreateTablet for tablet 3018fb4c08d3462f90e72e4df6d716c8 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260204 08:58:19.040423 16519 tablet_service.cc:1505] Processing CreateTablet for tablet 29067ae5902a405283277bb95a626f04 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260204 08:58:19.030745 16663 tablet_service.cc:1505] Processing CreateTablet for tablet 147ea8d1b63e4e9e8f084676f3f0ea12 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260204 08:58:19.042627 16589 tablet_service.cc:1505] Processing CreateTablet for tablet e039f673c9814556a561795c68ee2950 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260204 08:58:19.019299 16594 tablet_service.cc:1505] Processing CreateTablet for tablet 3fd60f400d0147959fa060cf8359ae32 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260204 08:58:19.046440 16722 raft_consensus.cc:385] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:19.057893 16722 raft_consensus.cc:740] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:19.058724 16722 consensus_queue.cc:260] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.051266 16666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3200a486ed4e50b8cd3fbace254888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.061534 16667 tablet_service.cc:1505] Processing CreateTablet for tablet 0f175f5811e74a91b26e6ac39bc9d0b7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260204 08:58:19.053097 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0dd5730ea04490876711f04afa95e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.056092 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ec06ad82864d3a91228c325fd1af2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.050242 16670 tablet_service.cc:1505] Processing CreateTablet for tablet 4d0dd5730ea04490876711f04afa95e5 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260204 08:58:19.063587 16663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147ea8d1b63e4e9e8f084676f3f0ea12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.089717 16520 tablet_service.cc:1505] Processing CreateTablet for tablet 72c4736a5d244206a366cb1166df369e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260204 08:58:19.091871 16667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f175f5811e74a91b26e6ac39bc9d0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.094429 16671 tablet_service.cc:1505] Processing CreateTablet for tablet 61ec06ad82864d3a91228c325fd1af2d (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260204 08:58:19.097074 16515 tablet_service.cc:1505] Processing CreateTablet for tablet 3018fb4c08d3462f90e72e4df6d716c8 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260204 08:58:19.097708 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0dd5730ea04490876711f04afa95e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.074509 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29067ae5902a405283277bb95a626f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.075709 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3018fb4c08d3462f90e72e4df6d716c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.101014 16725 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:19.119206 16521 tablet_service.cc:1505] Processing CreateTablet for tablet e039f673c9814556a561795c68ee2950 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260204 08:58:19.124300 16723 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:19.124895 16723 ts_tablet_manager.cc:1403] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.246s user 0.019s sys 0.019s
I20260204 08:58:19.124302 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ec06ad82864d3a91228c325fd1af2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.113560 16727 raft_consensus.cc:493] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:19.113751 16557 heartbeater.cc:499] Master 127.15.3.254:45355 was elected leader, sending a full tablet report...
I20260204 08:58:19.132010 16727 raft_consensus.cc:515] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.115960 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd60f400d0147959fa060cf8359ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.134565 16727 leader_election.cc:290] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:19.107798 16593 tablet_service.cc:1505] Processing CreateTablet for tablet 4bff71b9804b47cc915e34b23012509e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260204 08:58:19.141340 16517 tablet_service.cc:1505] Processing CreateTablet for tablet deb06db695bc4cd7bcef0b6d5f27c3e3 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260204 08:58:19.143146 16725 tablet_bootstrap.cc:654] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:19.143785 16522 tablet_service.cc:1505] Processing CreateTablet for tablet 4bff71b9804b47cc915e34b23012509e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260204 08:58:19.145931 16669 tablet_service.cc:1505] Processing CreateTablet for tablet 29067ae5902a405283277bb95a626f04 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260204 08:58:19.162094 16669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29067ae5902a405283277bb95a626f04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.168612 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e039f673c9814556a561795c68ee2950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.164568 16723 raft_consensus.cc:359] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.175019 16723 raft_consensus.cc:385] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:19.175371 16723 raft_consensus.cc:740] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:19.176379 16723 consensus_queue.cc:260] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.173448 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb06db695bc4cd7bcef0b6d5f27c3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.175307 16722 ts_tablet_manager.cc:1434] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.160s user 0.014s sys 0.026s
W20260204 08:58:19.183974 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:58:19.184859 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bff71b9804b47cc915e34b23012509e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.188282 16591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c4736a5d244206a366cb1166df369e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.192488 16594 tablet_service.cc:1505] Processing CreateTablet for tablet be0afba4e5c14c95870971bc8c2c7225 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260204 08:58:19.193846 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0afba4e5c14c95870971bc8c2c7225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.194500 16722 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:19.196641 16592 tablet_service.cc:1505] Processing CreateTablet for tablet deb06db695bc4cd7bcef0b6d5f27c3e3 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260204 08:58:19.197921 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb06db695bc4cd7bcef0b6d5f27c3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.206928 16516 tablet_service.cc:1505] Processing CreateTablet for tablet be0afba4e5c14c95870971bc8c2c7225 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260204 08:58:19.211957 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c4736a5d244206a366cb1166df369e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.215968 16515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3018fb4c08d3462f90e72e4df6d716c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.216104 16591 tablet_service.cc:1505] Processing CreateTablet for tablet 063bb12920e44068a818b00a8573328e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260204 08:58:19.218487 16591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063bb12920e44068a818b00a8573328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.219952 16521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e039f673c9814556a561795c68ee2950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.220965 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bff71b9804b47cc915e34b23012509e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.227373 16722 tablet_bootstrap.cc:654] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:19.229264 16597 tablet_service.cc:1505] Processing CreateTablet for tablet a2c39bf3d0c849a1aa4ef353e0e67991 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260204 08:58:19.232369 16597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c39bf3d0c849a1aa4ef353e0e67991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.235081 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a1d2d7d1f3440c48f319087b6e44ee0" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:19.236969 16497 leader_election.cc:343] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.238577 16665 tablet_service.cc:1505] Processing CreateTablet for tablet e039f673c9814556a561795c68ee2950 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260204 08:58:19.223193 16590 tablet_service.cc:1505] Processing CreateTablet for tablet aa4d147d1fb14e6ca905000e39085dfa (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260204 08:58:19.239912 16665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e039f673c9814556a561795c68ee2950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.240823 16590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa4d147d1fb14e6ca905000e39085dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.244532 16596 tablet_service.cc:1505] Processing CreateTablet for tablet b4a8f14fd5174a4d98b1849c67325173 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260204 08:58:19.245798 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a8f14fd5174a4d98b1849c67325173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.252419 16670 tablet_service.cc:1505] Processing CreateTablet for tablet 3fd60f400d0147959fa060cf8359ae32 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260204 08:58:19.253656 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd60f400d0147959fa060cf8359ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.250861 16667 tablet_service.cc:1505] Processing CreateTablet for tablet be0afba4e5c14c95870971bc8c2c7225 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260204 08:58:19.266973 16667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0afba4e5c14c95870971bc8c2c7225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.272998 16663 tablet_service.cc:1505] Processing CreateTablet for tablet aa4d147d1fb14e6ca905000e39085dfa (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260204 08:58:19.274246 16663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa4d147d1fb14e6ca905000e39085dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.274084 16669 tablet_service.cc:1505] Processing CreateTablet for tablet b4a8f14fd5174a4d98b1849c67325173 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260204 08:58:19.275346 16669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a8f14fd5174a4d98b1849c67325173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.275875 16666 tablet_service.cc:1505] Processing CreateTablet for tablet 063bb12920e44068a818b00a8573328e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260204 08:58:19.276230 16588 tablet_service.cc:1505] Processing CreateTablet for tablet 326778f65c8845f5bc8e4a236d093bfe (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260204 08:58:19.283663 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0afba4e5c14c95870971bc8c2c7225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.283996 16588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326778f65c8845f5bc8e4a236d093bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.284760 16514 tablet_service.cc:1505] Processing CreateTablet for tablet 063bb12920e44068a818b00a8573328e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260204 08:58:19.285986 16514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063bb12920e44068a818b00a8573328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.290170 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a1d2d7d1f3440c48f319087b6e44ee0" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:19.290169 16662 tablet_service.cc:1505] Processing CreateTablet for tablet 3018fb4c08d3462f90e72e4df6d716c8 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260204 08:58:19.268148 16725 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:19.296252 16725 ts_tablet_manager.cc:1403] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.196s user 0.008s sys 0.005s
I20260204 08:58:19.299008 16725 raft_consensus.cc:359] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
W20260204 08:58:19.300050 16498 leader_election.cc:343] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.300191 16591 tablet_service.cc:1505] Processing CreateTablet for tablet d51b94b814b049a19e2c94de66731467 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260204 08:58:19.294886 16592 tablet_service.cc:1505] Processing CreateTablet for tablet 10d633fea539421b8df68b6b69649892 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260204 08:58:19.307034 16725 raft_consensus.cc:385] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:19.311203 16591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51b94b814b049a19e2c94de66731467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.283974 16664 tablet_service.cc:1505] Processing CreateTablet for tablet 72c4736a5d244206a366cb1166df369e (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260204 08:58:19.311787 16518 tablet_service.cc:1505] Processing CreateTablet for tablet aa4d147d1fb14e6ca905000e39085dfa (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260204 08:58:19.313036 16593 tablet_service.cc:1505] Processing CreateTablet for tablet b4a8c1585bad41eb94f02214a751600b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260204 08:58:19.314289 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a8c1585bad41eb94f02214a751600b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.308691 16498 leader_election.cc:304] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:19.315924 16666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063bb12920e44068a818b00a8573328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.318056 16664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c4736a5d244206a366cb1166df369e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.312992 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa4d147d1fb14e6ca905000e39085dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.267926 16513 tablet_service.cc:1505] Processing CreateTablet for tablet 3fd60f400d0147959fa060cf8359ae32 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260204 08:58:19.324041 16662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3018fb4c08d3462f90e72e4df6d716c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.324719 16513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd60f400d0147959fa060cf8359ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.310141 16725 raft_consensus.cc:740] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:19.328799 16725 consensus_queue.cc:260] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:19.331243 16728 raft_consensus.cc:2749] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:19.337253 16519 tablet_service.cc:1505] Processing CreateTablet for tablet b4a8f14fd5174a4d98b1849c67325173 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260204 08:58:19.338001 16515 tablet_service.cc:1505] Processing CreateTablet for tablet a2c39bf3d0c849a1aa4ef353e0e67991 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260204 08:58:19.338537 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a8f14fd5174a4d98b1849c67325173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.339177 16515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c39bf3d0c849a1aa4ef353e0e67991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.324759 16722 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:19.354456 16725 ts_tablet_manager.cc:1434] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.058s user 0.003s sys 0.007s
I20260204 08:58:19.355770 16706 heartbeater.cc:499] Master 127.15.3.254:45355 was elected leader, sending a full tablet report...
W20260204 08:58:19.358470 16558 tablet.cc:2378] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260204 08:58:19.361409 16670 tablet_service.cc:1505] Processing CreateTablet for tablet 326778f65c8845f5bc8e4a236d093bfe (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260204 08:58:19.363023 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326778f65c8845f5bc8e4a236d093bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.337917 16671 tablet_service.cc:1505] Processing CreateTablet for tablet a2c39bf3d0c849a1aa4ef353e0e67991 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260204 08:58:19.367482 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c39bf3d0c849a1aa4ef353e0e67991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.374843 16520 tablet_service.cc:1505] Processing CreateTablet for tablet d51b94b814b049a19e2c94de66731467 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260204 08:58:19.381050 16668 tablet_service.cc:1505] Processing CreateTablet for tablet d51b94b814b049a19e2c94de66731467 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260204 08:58:19.382368 16668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51b94b814b049a19e2c94de66731467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.384124 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d633fea539421b8df68b6b69649892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.386766 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51b94b814b049a19e2c94de66731467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.386384 16588 tablet_service.cc:1505] Processing CreateTablet for tablet 91a7c7c248c04840817bf3090ca01597 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260204 08:58:19.387928 16722 ts_tablet_manager.cc:1403] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.194s user 0.011s sys 0.003s
I20260204 08:58:19.393738 16588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a7c7c248c04840817bf3090ca01597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.396245 16725 tablet_bootstrap.cc:492] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:19.395905 16722 raft_consensus.cc:359] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:19.396610 16722 raft_consensus.cc:385] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:19.396950 16722 raft_consensus.cc:740] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:19.397634 16722 consensus_queue.cc:260] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:19.387261 16590 tablet_service.cc:1505] Processing CreateTablet for tablet aac4f009108d4057aee3fb4274b6d320 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260204 08:58:19.399974 16667 tablet_service.cc:1505] Processing CreateTablet for tablet b4a8c1585bad41eb94f02214a751600b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260204 08:58:19.400343 16590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac4f009108d4057aee3fb4274b6d320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.401018 16733 raft_consensus.cc:493] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:19.401503 16733 raft_consensus.cc:515] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.403869 16632 heartbeater.cc:499] Master 127.15.3.254:45355 was elected leader, sending a full tablet report...
I20260204 08:58:19.405753 16522 tablet_service.cc:1505] Processing CreateTablet for tablet 326778f65c8845f5bc8e4a236d093bfe (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260204 08:58:19.410604 16723 ts_tablet_manager.cc:1434] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.285s user 0.007s sys 0.011s
I20260204 08:58:19.411592 16723 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:19.418526 16596 tablet_service.cc:1505] Processing CreateTablet for tablet 569b49ee7fc94d7bab7861620dbccfed (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260204 08:58:19.419946 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569b49ee7fc94d7bab7861620dbccfed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.420320 16667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a8c1585bad41eb94f02214a751600b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.420668 16594 tablet_service.cc:1505] Processing CreateTablet for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260204 08:58:19.421916 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.424381 16733 leader_election.cc:290] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:19.428526 16665 tablet_service.cc:1505] Processing CreateTablet for tablet 10d633fea539421b8df68b6b69649892 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260204 08:58:19.428753 16597 tablet_service.cc:1505] Processing CreateTablet for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260204 08:58:19.429852 16665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d633fea539421b8df68b6b69649892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.430068 16597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.443215 16722 ts_tablet_manager.cc:1434] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.050s user 0.005s sys 0.001s
I20260204 08:58:19.446447 16722 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:19.447028 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326778f65c8845f5bc8e4a236d093bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.450244 16521 tablet_service.cc:1505] Processing CreateTablet for tablet 10d633fea539421b8df68b6b69649892 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260204 08:58:19.451480 16521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d633fea539421b8df68b6b69649892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.319535 16595 tablet_service.cc:1505] Processing CreateTablet for tablet 457a55a8c34648f6ae2a009fcb9fd749 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260204 08:58:19.461124 16516 tablet_service.cc:1505] Processing CreateTablet for tablet aac4f009108d4057aee3fb4274b6d320 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260204 08:58:19.465736 16517 tablet_service.cc:1505] Processing CreateTablet for tablet b4a8c1585bad41eb94f02214a751600b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260204 08:58:19.459149 16671 tablet_service.cc:1505] Processing CreateTablet for tablet 457a55a8c34648f6ae2a009fcb9fd749 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260204 08:58:19.474622 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457a55a8c34648f6ae2a009fcb9fd749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.477517 16725 tablet_bootstrap.cc:654] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:19.482954 16514 tablet_service.cc:1505] Processing CreateTablet for tablet 457a55a8c34648f6ae2a009fcb9fd749 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260204 08:58:19.483596 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac4f009108d4057aee3fb4274b6d320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.496058 16723 tablet_bootstrap.cc:654] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:19.513736 16722 tablet_bootstrap.cc:654] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:19.513453 16666 tablet_service.cc:1505] Processing CreateTablet for tablet 91a7c7c248c04840817bf3090ca01597 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260204 08:58:19.514715 16666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a7c7c248c04840817bf3090ca01597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.520778 16669 tablet_service.cc:1505] Processing CreateTablet for tablet aac4f009108d4057aee3fb4274b6d320 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260204 08:58:19.520929 16589 tablet_service.cc:1505] Processing CreateTablet for tablet 92baf1e833884e0b9132f786b6d9791f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260204 08:58:19.522145 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92baf1e833884e0b9132f786b6d9791f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.526199 16663 tablet_service.cc:1505] Processing CreateTablet for tablet 569b49ee7fc94d7bab7861620dbccfed (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260204 08:58:19.533744 16662 tablet_service.cc:1505] Processing CreateTablet for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260204 08:58:19.539089 16664 tablet_service.cc:1505] Processing CreateTablet for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260204 08:58:19.539827 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457a55a8c34648f6ae2a009fcb9fd749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.540088 16734 raft_consensus.cc:493] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:19.540563 16734 raft_consensus.cc:515] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:19.541174 16665 tablet_service.cc:1505] Processing CreateTablet for tablet 92baf1e833884e0b9132f786b6d9791f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260204 08:58:19.542375 16665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92baf1e833884e0b9132f786b6d9791f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.545231 16734 leader_election.cc:290] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:19.554296 16663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569b49ee7fc94d7bab7861620dbccfed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.555454 16662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.564850 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a8c1585bad41eb94f02214a751600b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.566579 16516 tablet_service.cc:1505] Processing CreateTablet for tablet 91a7c7c248c04840817bf3090ca01597 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260204 08:58:19.567906 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a7c7c248c04840817bf3090ca01597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.568710 16514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457a55a8c34648f6ae2a009fcb9fd749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.578666 16513 tablet_service.cc:1505] Processing CreateTablet for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260204 08:58:19.580309 16591 tablet_service.cc:1505] Processing CreateTablet for tablet fc74f40262504431847cf4419a26b480 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260204 08:58:19.583841 16513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.584426 16591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc74f40262504431847cf4419a26b480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.586647 16670 tablet_service.cc:1505] Processing CreateTablet for tablet 4dc53e7c74664efe82fc5edb6dfca943 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260204 08:58:19.587883 16519 tablet_service.cc:1505] Processing CreateTablet for tablet 92baf1e833884e0b9132f786b6d9791f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260204 08:58:19.589085 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92baf1e833884e0b9132f786b6d9791f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.589284 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:19.579988 16522 tablet_service.cc:1505] Processing CreateTablet for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260204 08:58:19.591727 16669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac4f009108d4057aee3fb4274b6d320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.592422 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.582077 16593 tablet_service.cc:1505] Processing CreateTablet for tablet e6a3887aa0f64b1a8d49dc7e0e061459 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260204 08:58:19.595427 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a3887aa0f64b1a8d49dc7e0e061459. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:58:19.596202 16572 leader_election.cc:343] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.570005 16596 tablet_service.cc:1505] Processing CreateTablet for tablet 4dc53e7c74664efe82fc5edb6dfca943 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260204 08:58:19.598508 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc53e7c74664efe82fc5edb6dfca943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.602087 16723 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:19.602579 16723 ts_tablet_manager.cc:1403] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.191s user 0.017s sys 0.004s
I20260204 08:58:19.605384 16723 raft_consensus.cc:359] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.606101 16723 raft_consensus.cc:385] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:19.606382 16723 raft_consensus.cc:740] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:19.607190 16723 consensus_queue.cc:260] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.615279 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:19.616758 16572 leader_election.cc:343] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.616899 16590 tablet_service.cc:1505] Processing CreateTablet for tablet d7f0ef5121b748d18bbd7783a318fbc7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260204 08:58:19.617193 16572 leader_election.cc:304] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:19.618130 16590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f0ef5121b748d18bbd7783a318fbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.619141 16735 raft_consensus.cc:2749] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:19.621505 16588 tablet_service.cc:1505] Processing CreateTablet for tablet a2e4ca7bedb84f7ba570333f98fb5de5 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260204 08:58:19.631542 16664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.647583 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc53e7c74664efe82fc5edb6dfca943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.649778 16735 raft_consensus.cc:493] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:19.650254 16735 raft_consensus.cc:515] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.652199 16735 leader_election.cc:290] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:19.654132 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a1d2d7d1f3440c48f319087b6e44ee0" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:19.655939 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a1d2d7d1f3440c48f319087b6e44ee0" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:19.656533 16532 raft_consensus.cc:2468] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:19.657577 16516 tablet_service.cc:1505] Processing CreateTablet for tablet fc74f40262504431847cf4419a26b480 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260204 08:58:19.658286 16667 tablet_service.cc:1505] Processing CreateTablet for tablet d7f0ef5121b748d18bbd7783a318fbc7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260204 08:58:19.658797 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc74f40262504431847cf4419a26b480. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:58:19.655864 16572 leader_election.cc:343] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.662657 16572 leader_election.cc:304] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:19.664088 16735 raft_consensus.cc:2804] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:19.664433 16735 raft_consensus.cc:493] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:19.664750 16735 raft_consensus.cc:3060] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:19.665731 16670 tablet_service.cc:1505] Processing CreateTablet for tablet fc74f40262504431847cf4419a26b480 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260204 08:58:19.667028 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc74f40262504431847cf4419a26b480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.643630 16518 tablet_service.cc:1505] Processing CreateTablet for tablet 569b49ee7fc94d7bab7861620dbccfed (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260204 08:58:19.668767 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569b49ee7fc94d7bab7861620dbccfed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.671453 16735 raft_consensus.cc:515] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.674088 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a1d2d7d1f3440c48f319087b6e44ee0" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:19.674625 16532 raft_consensus.cc:3060] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:19.623497 16595 tablet_service.cc:1505] Processing CreateTablet for tablet c77c8d18f5274899a308f09e7aa99de3 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260204 08:58:19.680860 16667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f0ef5121b748d18bbd7783a318fbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.686446 16532 raft_consensus.cc:2468] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:19.691933 16516 tablet_service.cc:1505] Processing CreateTablet for tablet d7f0ef5121b748d18bbd7783a318fbc7 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260204 08:58:19.692608 16521 tablet_service.cc:1505] Processing CreateTablet for tablet 4dc53e7c74664efe82fc5edb6dfca943 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260204 08:58:19.694216 16520 tablet_service.cc:1505] Processing CreateTablet for tablet e6a3887aa0f64b1a8d49dc7e0e061459 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260204 08:58:19.695315 16723 ts_tablet_manager.cc:1434] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.092s user 0.006s sys 0.001s
I20260204 08:58:19.698257 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:19.755982 16531 raft_consensus.cc:2468] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:19.700060 16668 tablet_service.cc:1505] Processing CreateTablet for tablet e6a3887aa0f64b1a8d49dc7e0e061459 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260204 08:58:19.757252 16668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a3887aa0f64b1a8d49dc7e0e061459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.757179 16646 leader_election.cc:304] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:19.758025 16734 raft_consensus.cc:2804] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:19.758361 16734 raft_consensus.cc:493] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:19.758685 16734 raft_consensus.cc:3060] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:19.758766 16723 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:19.701462 16671 tablet_service.cc:1505] Processing CreateTablet for tablet a2e4ca7bedb84f7ba570333f98fb5de5 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260204 08:58:19.706020 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a1d2d7d1f3440c48f319087b6e44ee0" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:19.707065 16593 tablet_service.cc:1505] Processing CreateTablet for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260204 08:58:19.711778 16725 tablet_bootstrap.cc:492] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:19.760520 16725 ts_tablet_manager.cc:1403] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.364s user 0.010s sys 0.010s
I20260204 08:58:19.761242 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e4ca7bedb84f7ba570333f98fb5de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.740926 16722 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:19.763233 16722 ts_tablet_manager.cc:1403] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.317s user 0.003s sys 0.031s
I20260204 08:58:19.763072 16725 raft_consensus.cc:359] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.718571 16663 tablet_service.cc:1505] Processing CreateTablet for tablet c77c8d18f5274899a308f09e7aa99de3 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260204 08:58:19.764468 16663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77c8d18f5274899a308f09e7aa99de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.719417 16735 leader_election.cc:290] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:19.719848 16515 tablet_service.cc:1505] Processing CreateTablet for tablet a2e4ca7bedb84f7ba570333f98fb5de5 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260204 08:58:19.723166 16521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc53e7c74664efe82fc5edb6dfca943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.728879 16518 tablet_service.cc:1505] Processing CreateTablet for tablet 68912efba25745d9ba6be48c71f92a38 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260204 08:58:19.724153 16519 tablet_service.cc:1505] Processing CreateTablet for tablet 796b324679b4492db7f68598b0a2d4e2 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260204 08:58:19.732290 16670 tablet_service.cc:1505] Processing CreateTablet for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260204 08:58:19.703051 16588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e4ca7bedb84f7ba570333f98fb5de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.737142 16666 tablet_service.cc:1505] Processing CreateTablet for tablet 68912efba25745d9ba6be48c71f92a38 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260204 08:58:19.738961 16662 tablet_service.cc:1505] Processing CreateTablet for tablet 796b324679b4492db7f68598b0a2d4e2 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260204 08:58:19.739504 16513 tablet_service.cc:1505] Processing CreateTablet for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260204 08:58:19.740962 16665 tablet_service.cc:1505] Processing CreateTablet for tablet f832ab776a0c43a4972fba456498de8c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260204 08:58:19.742659 16594 tablet_service.cc:1505] Processing CreateTablet for tablet 68912efba25745d9ba6be48c71f92a38 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260204 08:58:19.720503 16592 tablet_service.cc:1505] Processing CreateTablet for tablet 796b324679b4492db7f68598b0a2d4e2 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260204 08:58:19.750985 16591 tablet_service.cc:1505] Processing CreateTablet for tablet f832ab776a0c43a4972fba456498de8c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260204 08:58:19.754937 16596 tablet_service.cc:1505] Processing CreateTablet for tablet 56a1c6e078b242738f19a73c490d3830 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260204 08:58:19.713460 16572 leader_election.cc:304] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:19.765887 16725 raft_consensus.cc:385] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:19.768016 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f0ef5121b748d18bbd7783a318fbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.772922 16735 raft_consensus.cc:2804] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:19.773411 16735 raft_consensus.cc:697] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:19.771440 16662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796b324679b4492db7f68598b0a2d4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.773940 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:19.774475 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796b324679b4492db7f68598b0a2d4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.774243 16735 consensus_queue.cc:237] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:19.775344 16647 leader_election.cc:343] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.776648 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a3887aa0f64b1a8d49dc7e0e061459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.777964 16513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:58:19.772388 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 59028.4us
I20260204 08:58:19.779754 16515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e4ca7bedb84f7ba570333f98fb5de5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:58:19.780339 16572 leader_election.cc:343] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.781980 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68912efba25745d9ba6be48c71f92a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.782223 16665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f832ab776a0c43a4972fba456498de8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.772647 16725 raft_consensus.cc:740] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:19.783483 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.783088 16725 consensus_queue.cc:260] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.789419 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796b324679b4492db7f68598b0a2d4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.790434 16514 tablet_service.cc:1505] Processing CreateTablet for tablet f832ab776a0c43a4972fba456498de8c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260204 08:58:19.719316 16522 tablet_service.cc:1505] Processing CreateTablet for tablet c77c8d18f5274899a308f09e7aa99de3 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260204 08:58:19.801232 16723 tablet_bootstrap.cc:654] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:19.792237 16591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f832ab776a0c43a4972fba456498de8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.791630 16514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f832ab776a0c43a4972fba456498de8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.765671 16734 raft_consensus.cc:515] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:19.759665 16669 tablet_service.cc:1505] Processing CreateTablet for tablet 56a1c6e078b242738f19a73c490d3830 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260204 08:58:19.809876 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a1c6e078b242738f19a73c490d3830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.810590 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77c8d18f5274899a308f09e7aa99de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.811061 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68912efba25745d9ba6be48c71f92a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.829541 16725 ts_tablet_manager.cc:1434] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.069s user 0.000s sys 0.006s
I20260204 08:58:19.830367 16590 tablet_service.cc:1505] Processing CreateTablet for tablet 82c2a342cc8c4de99746b3951b711b0c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260204 08:58:19.832376 16725 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:19.835752 16669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a1c6e078b242738f19a73c490d3830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.844004 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77c8d18f5274899a308f09e7aa99de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.846395 16746 raft_consensus.cc:493] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:19.846886 16746 raft_consensus.cc:515] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.854261 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:19.854528 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:19.855078 16531 raft_consensus.cc:3060] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:58:19.855571 16647 leader_election.cc:343] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.855981 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:19.856113 16746 leader_election.cc:290] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
W20260204 08:58:19.857290 16646 leader_election.cc:343] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.857729 16646 leader_election.cc:304] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:19.858613 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.862059 16746 raft_consensus.cc:2749] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:19.858829 16430 catalog_manager.cc:5654] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:19.864224 16596 tablet_service.cc:1505] Processing CreateTablet for tablet 801ee654117f4d37b4ad0c66b46fd4e4 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260204 08:58:19.865955 16531 raft_consensus.cc:2468] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:19.808137 16722 raft_consensus.cc:359] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.868661 16734 leader_election.cc:290] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:19.869812 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:19.896867 16664 tablet_service.cc:1505] Processing CreateTablet for tablet 20fa246d3c414fa0b616da38a625bdfe (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260204 08:58:19.897328 16647 leader_election.cc:343] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:19.898092 16722 raft_consensus.cc:385] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:19.898656 16646 leader_election.cc:304] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:19.872515 16667 tablet_service.cc:1505] Processing CreateTablet for tablet 35fde83161df49e09eb28ee05a4ad35f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260204 08:58:19.884423 16666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68912efba25745d9ba6be48c71f92a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.884626 16725 tablet_bootstrap.cc:654] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:19.888206 16668 tablet_service.cc:1505] Processing CreateTablet for tablet 801ee654117f4d37b4ad0c66b46fd4e4 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260204 08:58:19.849177 16597 tablet_service.cc:1505] Processing CreateTablet for tablet 35fde83161df49e09eb28ee05a4ad35f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260204 08:58:19.898102 16723 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:19.881170 16662 tablet_service.cc:1505] Processing CreateTablet for tablet 82c2a342cc8c4de99746b3951b711b0c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260204 08:58:19.903565 16662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c2a342cc8c4de99746b3951b711b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.904137 16517 tablet_service.cc:1505] Processing CreateTablet for tablet 35fde83161df49e09eb28ee05a4ad35f (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260204 08:58:19.902194 16734 raft_consensus.cc:2804] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:19.902696 16723 ts_tablet_manager.cc:1403] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.144s user 0.008s sys 0.008s
I20260204 08:58:19.905436 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fde83161df49e09eb28ee05a4ad35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.898667 16722 raft_consensus.cc:740] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:19.908164 16723 raft_consensus.cc:359] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:19.908358 16722 consensus_queue.cc:260] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:19.908876 16723 raft_consensus.cc:385] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:19.909153 16723 raft_consensus.cc:740] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:19.909714 16734 raft_consensus.cc:697] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:19.909271 16518 tablet_service.cc:1505] Processing CreateTablet for tablet 801ee654117f4d37b4ad0c66b46fd4e4 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260204 08:58:19.910755 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801ee654117f4d37b4ad0c66b46fd4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.910521 16734 consensus_queue.cc:237] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:19.901396 16590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c2a342cc8c4de99746b3951b711b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.911725 16521 tablet_service.cc:1505] Processing CreateTablet for tablet 3326e90f03344694ace417ed6615d3fa (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260204 08:58:19.912961 16521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3326e90f03344694ace417ed6615d3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.920519 16515 tablet_service.cc:1505] Processing CreateTablet for tablet 82c2a342cc8c4de99746b3951b711b0c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260204 08:58:19.921838 16515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c2a342cc8c4de99746b3951b711b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.930920 16723 consensus_queue.cc:260] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:19.931813 16597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fde83161df49e09eb28ee05a4ad35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.911537 16513 tablet_service.cc:1505] Processing CreateTablet for tablet 20fa246d3c414fa0b616da38a625bdfe (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260204 08:58:19.932787 16513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fa246d3c414fa0b616da38a625bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.933570 16723 ts_tablet_manager.cc:1434] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20260204 08:58:19.934535 16723 tablet_bootstrap.cc:492] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:19.923724 16516 tablet_service.cc:1505] Processing CreateTablet for tablet 56a1c6e078b242738f19a73c490d3830 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260204 08:58:19.940358 16671 tablet_service.cc:1505] Processing CreateTablet for tablet 3326e90f03344694ace417ed6615d3fa (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260204 08:58:19.940496 16591 tablet_service.cc:1505] Processing CreateTablet for tablet 3326e90f03344694ace417ed6615d3fa (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260204 08:58:19.943277 16663 tablet_service.cc:1505] Processing CreateTablet for tablet 8689b3435b4f43a1b5a8c5af26f23c2c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260204 08:58:19.946182 16670 tablet_service.cc:1505] Processing CreateTablet for tablet 0b534820859442b49b61eb04ce7e2363 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260204 08:58:19.946501 16669 tablet_service.cc:1505] Processing CreateTablet for tablet c4fba286cf394487ab1cf2b45d55835b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260204 08:58:19.948215 16666 tablet_service.cc:1505] Processing CreateTablet for tablet a2372d97d9af497ea9e6782d61032982 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260204 08:58:19.951841 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a1c6e078b242738f19a73c490d3830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.956108 16723 tablet_bootstrap.cc:654] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:19.960336 16664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fa246d3c414fa0b616da38a625bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.969674 16668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801ee654117f4d37b4ad0c66b46fd4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.971160 16667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fde83161df49e09eb28ee05a4ad35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.972880 16671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3326e90f03344694ace417ed6615d3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.974299 16520 tablet_service.cc:1505] Processing CreateTablet for tablet 8689b3435b4f43a1b5a8c5af26f23c2c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260204 08:58:19.967584 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801ee654117f4d37b4ad0c66b46fd4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:19.983865 16522 tablet_service.cc:1505] Processing CreateTablet for tablet 0b534820859442b49b61eb04ce7e2363 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260204 08:58:19.986661 16592 tablet_service.cc:1505] Processing CreateTablet for tablet 0b534820859442b49b61eb04ce7e2363 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260204 08:58:19.977459 16588 tablet_service.cc:1505] Processing CreateTablet for tablet 8689b3435b4f43a1b5a8c5af26f23c2c (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260204 08:58:19.996502 16749 raft_consensus.cc:493] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:19.997123 16749 raft_consensus.cc:515] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.005604 16517 tablet_service.cc:1505] Processing CreateTablet for tablet c4fba286cf394487ab1cf2b45d55835b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260204 08:58:20.005963 16514 tablet_service.cc:1505] Processing CreateTablet for tablet a2372d97d9af497ea9e6782d61032982 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260204 08:58:20.006816 16725 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.007311 16725 ts_tablet_manager.cc:1403] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.175s user 0.006s sys 0.006s
I20260204 08:58:20.008469 16591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3326e90f03344694ace417ed6615d3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.008953 16589 tablet_service.cc:1505] Processing CreateTablet for tablet 20fa246d3c414fa0b616da38a625bdfe (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260204 08:58:19.975543 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8689b3435b4f43a1b5a8c5af26f23c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.010185 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fa246d3c414fa0b616da38a625bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.012733 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b534820859442b49b61eb04ce7e2363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.018661 16725 raft_consensus.cc:359] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.019410 16725 raft_consensus.cc:385] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.020509 16666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2372d97d9af497ea9e6782d61032982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.021093 16588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8689b3435b4f43a1b5a8c5af26f23c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.022689 16749 leader_election.cc:290] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.023278 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.022925 16595 tablet_service.cc:1505] Processing CreateTablet for tablet c4fba286cf394487ab1cf2b45d55835b (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260204 08:58:20.037446 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
W20260204 08:58:20.038462 16497 leader_election.cc:343] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.049470 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fba286cf394487ab1cf2b45d55835b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.046569 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b534820859442b49b61eb04ce7e2363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.032426 16725 raft_consensus.cc:740] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.063861 16725 consensus_queue.cc:260] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.059204 16514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2372d97d9af497ea9e6782d61032982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.076059 16669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fba286cf394487ab1cf2b45d55835b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.076504 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fba286cf394487ab1cf2b45d55835b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.076848 16725 ts_tablet_manager.cc:1434] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.069s user 0.005s sys 0.005s
I20260204 08:58:20.077340 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b534820859442b49b61eb04ce7e2363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.077829 16725 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.085563 16722 ts_tablet_manager.cc:1434] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.322s user 0.013s sys 0.030s
I20260204 08:58:20.086930 16722 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.071962 16590 tablet_service.cc:1505] Processing CreateTablet for tablet a2372d97d9af497ea9e6782d61032982 (DEFAULT_TABLE table=test-workload [id=15f74ce0f0594e9285f208e67bcc1963]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260204 08:58:20.094655 16590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2372d97d9af497ea9e6782d61032982. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:58:20.074786 16498 leader_election.cc:343] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.098511 16498 leader_election.cc:304] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:20.099341 16749 raft_consensus.cc:2749] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260204 08:58:20.126775 16498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 53316.9us
W20260204 08:58:20.132079 16417 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 64946.8us
I20260204 08:58:20.136379 16723 tablet_bootstrap.cc:492] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.136883 16723 ts_tablet_manager.cc:1403] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.203s user 0.015s sys 0.004s
I20260204 08:58:20.139492 16723 raft_consensus.cc:359] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.152786 16723 raft_consensus.cc:385] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.153093 16723 raft_consensus.cc:740] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.153774 16723 consensus_queue.cc:260] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.148264 16722 tablet_bootstrap.cc:654] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.151417 16663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8689b3435b4f43a1b5a8c5af26f23c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:20.163784 16428 catalog_manager.cc:5654] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:20.171605 16723 ts_tablet_manager.cc:1434] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.034s user 0.006s sys 0.001s
I20260204 08:58:20.172605 16723 tablet_bootstrap.cc:492] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
W20260204 08:58:20.186210 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:58:20.192804 16725 tablet_bootstrap.cc:654] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.201188 16723 tablet_bootstrap.cc:654] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.214471 16735 raft_consensus.cc:493] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.214998 16735 raft_consensus.cc:515] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:20.216871 16735 leader_election.cc:290] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.218246 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.218277 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.219039 16531 raft_consensus.cc:2393] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f959652a42f34a81aca5da9faec0a7a3 in current term 1: Already voted for candidate 86e16045049f4f87a94336b5d2262328 in this term.
I20260204 08:58:20.220106 16572 leader_election.cc:304] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:20.220675 16735 raft_consensus.cc:3060] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.227840 16735 raft_consensus.cc:2749] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:20.228394 16722 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.228899 16722 ts_tablet_manager.cc:1403] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.142s user 0.016s sys 0.016s
I20260204 08:58:20.229765 16725 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.230154 16725 ts_tablet_manager.cc:1403] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.153s user 0.011s sys 0.005s
I20260204 08:58:20.230532 16723 tablet_bootstrap.cc:492] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.230980 16723 ts_tablet_manager.cc:1403] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.011s
I20260204 08:58:20.231585 16722 raft_consensus.cc:359] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.232335 16722 raft_consensus.cc:385] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.232146 16725 raft_consensus.cc:359] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.232657 16722 raft_consensus.cc:740] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.232853 16725 raft_consensus.cc:385] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.233153 16725 raft_consensus.cc:740] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.233369 16722 consensus_queue.cc:260] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.233554 16723 raft_consensus.cc:359] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.233772 16725 consensus_queue.cc:260] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.234336 16723 raft_consensus.cc:385] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.234652 16723 raft_consensus.cc:740] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.235299 16723 consensus_queue.cc:260] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.235978 16725 ts_tablet_manager.cc:1434] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:58:20.236038 16722 ts_tablet_manager.cc:1434] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260204 08:58:20.237061 16725 tablet_bootstrap.cc:492] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.237221 16722 tablet_bootstrap.cc:492] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.237542 16723 ts_tablet_manager.cc:1434] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260204 08:58:20.238399 16723 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.243101 16725 tablet_bootstrap.cc:654] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.244328 16723 tablet_bootstrap.cc:654] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.246398 16722 tablet_bootstrap.cc:654] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.255702 16723 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.256197 16723 ts_tablet_manager.cc:1403] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.004s
I20260204 08:58:20.257408 16722 tablet_bootstrap.cc:492] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.257942 16722 ts_tablet_manager.cc:1403] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.004s
I20260204 08:58:20.258786 16723 raft_consensus.cc:359] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.259474 16723 raft_consensus.cc:385] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.259599 16725 tablet_bootstrap.cc:492] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.259816 16723 raft_consensus.cc:740] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.260144 16725 ts_tablet_manager.cc:1403] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.023s user 0.019s sys 0.001s
I20260204 08:58:20.260537 16723 consensus_queue.cc:260] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.260828 16722 raft_consensus.cc:359] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.261811 16722 raft_consensus.cc:385] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.262197 16722 raft_consensus.cc:740] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.262778 16723 ts_tablet_manager.cc:1434] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:58:20.262701 16725 raft_consensus.cc:359] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.262899 16722 consensus_queue.cc:260] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.263441 16725 raft_consensus.cc:385] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.263864 16723 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.263787 16725 raft_consensus.cc:740] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.264652 16725 consensus_queue.cc:260] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.265439 16722 ts_tablet_manager.cc:1434] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260204 08:58:20.266352 16722 tablet_bootstrap.cc:492] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.269214 16725 ts_tablet_manager.cc:1434] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260204 08:58:20.269874 16723 tablet_bootstrap.cc:654] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.270211 16725 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.277091 16725 tablet_bootstrap.cc:654] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.282867 16722 tablet_bootstrap.cc:654] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.287886 16725 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.288357 16725 ts_tablet_manager.cc:1403] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260204 08:58:20.289161 16734 raft_consensus.cc:493] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.289587 16734 raft_consensus.cc:515] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.291451 16734 leader_election.cc:290] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.292879 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.293394 16723 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.292879 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.293841 16723 ts_tablet_manager.cc:1403] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.030s user 0.016s sys 0.012s
W20260204 08:58:20.294049 16647 leader_election.cc:343] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:20.294806 16646 leader_election.cc:343] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.294593 16725 raft_consensus.cc:359] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.295125 16646 leader_election.cc:304] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:20.295348 16725 raft_consensus.cc:385] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.295712 16746 raft_consensus.cc:493] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.296030 16734 raft_consensus.cc:2749] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:20.296144 16746 raft_consensus.cc:515] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.296420 16723 raft_consensus.cc:359] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.297096 16723 raft_consensus.cc:385] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.297374 16723 raft_consensus.cc:740] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.297602 16722 tablet_bootstrap.cc:492] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.297763 16746 leader_election.cc:290] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.298040 16722 ts_tablet_manager.cc:1403] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.004s
I20260204 08:58:20.295724 16725 raft_consensus.cc:740] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.298105 16723 consensus_queue.cc:260] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.299501 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.299235 16725 consensus_queue.cc:260] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.300094 16607 raft_consensus.cc:2468] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.298434 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.303306 16723 ts_tablet_manager.cc:1434] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260204 08:58:20.303912 16725 ts_tablet_manager.cc:1434] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260204 08:58:20.304271 16723 tablet_bootstrap.cc:492] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.304809 16725 tablet_bootstrap.cc:492] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.301178 16647 leader_election.cc:304] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:20.305599 16746 raft_consensus.cc:2804] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.305938 16746 raft_consensus.cc:493] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.306234 16746 raft_consensus.cc:3060] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.310693 16723 tablet_bootstrap.cc:654] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.310913 16725 tablet_bootstrap.cc:654] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
W20260204 08:58:20.310983 16646 leader_election.cc:343] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.315244 16746 raft_consensus.cc:515] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.319799 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
W20260204 08:58:20.321699 16646 leader_election.cc:343] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.301157 16722 raft_consensus.cc:359] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.322346 16722 raft_consensus.cc:385] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.322660 16722 raft_consensus.cc:740] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.324746 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:20.325349 16607 raft_consensus.cc:3060] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.331827 16746 leader_election.cc:290] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.332682 16722 consensus_queue.cc:260] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.333977 16607 raft_consensus.cc:2468] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:20.335283 16647 leader_election.cc:304] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:20.336541 16746 raft_consensus.cc:2804] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.337661 16746 raft_consensus.cc:697] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:20.338120 16722 ts_tablet_manager.cc:1434] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.039s user 0.004s sys 0.001s
I20260204 08:58:20.338660 16746 consensus_queue.cc:237] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.339196 16722 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.344215 16725 tablet_bootstrap.cc:492] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.344739 16725 ts_tablet_manager.cc:1403] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.040s user 0.024s sys 0.008s
I20260204 08:58:20.345333 16722 tablet_bootstrap.cc:654] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.347556 16725 raft_consensus.cc:359] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.347993 16723 tablet_bootstrap.cc:492] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.349341 16725 raft_consensus.cc:385] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.349756 16725 raft_consensus.cc:740] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.349903 16723 ts_tablet_manager.cc:1403] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.046s user 0.018s sys 0.019s
I20260204 08:58:20.350517 16725 consensus_queue.cc:260] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.352854 16725 ts_tablet_manager.cc:1434] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260204 08:58:20.352710 16723 raft_consensus.cc:359] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.353318 16723 raft_consensus.cc:385] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.353581 16723 raft_consensus.cc:740] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.353788 16725 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.354238 16723 consensus_queue.cc:260] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.353907 16430 catalog_manager.cc:5654] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:20.359856 16722 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.360116 16725 tablet_bootstrap.cc:654] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.360319 16722 ts_tablet_manager.cc:1403] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.001s
I20260204 08:58:20.364286 16723 ts_tablet_manager.cc:1434] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.014s user 0.004s sys 0.002s
I20260204 08:58:20.364732 16734 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:20.371730 16723 tablet_bootstrap.cc:492] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.374814 16722 raft_consensus.cc:359] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.376349 16722 raft_consensus.cc:385] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.376668 16735 raft_consensus.cc:493] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.378502 16735 raft_consensus.cc:515] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.382462 16735 leader_election.cc:290] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.376698 16722 raft_consensus.cc:740] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.383153 16746 raft_consensus.cc:493] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.383493 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.383628 16746 raft_consensus.cc:515] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.383735 16722 consensus_queue.cc:260] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:20.385198 16572 consensus_peers.cc:597] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:20.389371 16722 ts_tablet_manager.cc:1434] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.029s user 0.008s sys 0.000s
I20260204 08:58:20.386499 16746 leader_election.cc:290] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.386489 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8c54bb34a3c42489cc93960f1717406" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.393232 16725 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.391992 16723 tablet_bootstrap.cc:654] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.386770 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8c54bb34a3c42489cc93960f1717406" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.397746 16725 ts_tablet_manager.cc:1403] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.044s user 0.015s sys 0.020s
I20260204 08:58:20.396998 16722 tablet_bootstrap.cc:492] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.399838 16606 raft_consensus.cc:2468] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.401530 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.405561 16681 raft_consensus.cc:2468] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:20.406080 16647 leader_election.cc:304] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
W20260204 08:58:20.404323 16572 leader_election.cc:343] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.407112 16735 consensus_queue.cc:1048] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:20.409241 16572 leader_election.cc:304] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:20.404685 16531 raft_consensus.cc:2468] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.410614 16735 raft_consensus.cc:2804] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.410964 16735 raft_consensus.cc:493] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.411275 16735 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.415423 16722 tablet_bootstrap.cc:654] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.416700 16773 raft_consensus.cc:2804] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.417100 16773 raft_consensus.cc:493] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.417409 16773 raft_consensus.cc:3060] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.418942 16735 raft_consensus.cc:515] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.404633 16725 raft_consensus.cc:359] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.419829 16725 raft_consensus.cc:385] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.420099 16725 raft_consensus.cc:740] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.420989 16735 leader_election.cc:290] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.420725 16725 consensus_queue.cc:260] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.424213 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:20.424281 16734 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:58:20.425554 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:20.432847 16681 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.433393 16725 ts_tablet_manager.cc:1434] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
I20260204 08:58:20.434247 16725 tablet_bootstrap.cc:492] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.439884 16725 tablet_bootstrap.cc:654] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.430493 16773 raft_consensus.cc:515] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.450521 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8c54bb34a3c42489cc93960f1717406" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:20.451211 16531 raft_consensus.cc:3060] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.464097 16773 leader_election.cc:290] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
W20260204 08:58:20.453235 16572 leader_election.cc:343] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.471316 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8c54bb34a3c42489cc93960f1717406" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:20.473587 16606 raft_consensus.cc:3060] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.452601 16681 raft_consensus.cc:2468] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:20.457734 16772 raft_consensus.cc:493] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.477828 16781 raft_consensus.cc:493] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.477761 16772 raft_consensus.cc:515] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.478485 16781 raft_consensus.cc:515] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.481119 16772 leader_election.cc:290] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.481688 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.484073 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "232077fdd4b44876ba13c53b7f42f888" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.484620 16530 raft_consensus.cc:2468] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:20.488473 16723 tablet_bootstrap.cc:492] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
W20260204 08:58:20.488660 16572 leader_election.cc:343] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.490099 16572 leader_election.cc:304] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:20.491012 16781 leader_election.cc:290] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.492063 16779 raft_consensus.cc:2804] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.492507 16779 raft_consensus.cc:493] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.492880 16779 raft_consensus.cc:3060] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.491191 16572 leader_election.cc:304] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:20.489164 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "232077fdd4b44876ba13c53b7f42f888" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.497870 16723 ts_tablet_manager.cc:1403] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.126s user 0.012s sys 0.004s
I20260204 08:58:20.490187 16531 raft_consensus.cc:2468] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:20.498004 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.499053 16680 raft_consensus.cc:2468] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:20.500592 16723 raft_consensus.cc:359] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.501207 16723 raft_consensus.cc:385] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.501477 16723 raft_consensus.cc:740] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.502046 16723 consensus_queue.cc:260] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.504210 16723 ts_tablet_manager.cc:1434] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260204 08:58:20.496603 16735 raft_consensus.cc:2804] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
W20260204 08:58:20.505700 16572 leader_election.cc:343] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.506266 16646 leader_election.cc:304] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:20.506700 16572 leader_election.cc:304] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:20.505636 16735 raft_consensus.cc:697] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:20.507174 16773 raft_consensus.cc:2804] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.507418 16781 raft_consensus.cc:2804] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.507686 16773 raft_consensus.cc:697] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:20.507809 16781 raft_consensus.cc:493] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.505867 16723 tablet_bootstrap.cc:492] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.506181 16779 raft_consensus.cc:515] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.508189 16781 raft_consensus.cc:3060] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.509632 16734 raft_consensus.cc:493] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.509528 16773 consensus_queue.cc:237] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.510090 16734 raft_consensus.cc:515] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.512688 16606 raft_consensus.cc:2468] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:20.512987 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.513797 16734 leader_election.cc:290] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.512693 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:20.514698 16647 leader_election.cc:343] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.514942 16532 raft_consensus.cc:2468] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.514962 16735 consensus_queue.cc:237] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.516875 16646 leader_election.cc:304] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:20.518165 16734 raft_consensus.cc:2804] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.518500 16734 raft_consensus.cc:493] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.518828 16734 raft_consensus.cc:3060] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.522857 16723 tablet_bootstrap.cc:654] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.519886 16779 leader_election.cc:290] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.520418 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "232077fdd4b44876ba13c53b7f42f888" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:20.524924 16532 raft_consensus.cc:3060] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.527298 16725 tablet_bootstrap.cc:492] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.527804 16725 ts_tablet_manager.cc:1403] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.094s user 0.023s sys 0.041s
I20260204 08:58:20.530162 16725 raft_consensus.cc:359] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.530761 16725 raft_consensus.cc:385] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.530997 16725 raft_consensus.cc:740] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.531571 16725 consensus_queue.cc:260] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.527432 16429 catalog_manager.cc:5654] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:20.537220 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "232077fdd4b44876ba13c53b7f42f888" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:20.537686 16532 raft_consensus.cc:2468] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
W20260204 08:58:20.538652 16572 leader_election.cc:343] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.539379 16572 leader_election.cc:304] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:20.540177 16779 raft_consensus.cc:2804] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.540613 16779 raft_consensus.cc:697] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:20.541345 16781 raft_consensus.cc:515] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.543184 16781 leader_election.cc:290] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.541358 16779 consensus_queue.cc:237] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.544677 16734 raft_consensus.cc:515] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.548425 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:20.550860 16725 ts_tablet_manager.cc:1434] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260204 08:58:20.548992 16532 raft_consensus.cc:3060] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.553087 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:20.554569 16722 tablet_bootstrap.cc:492] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.555009 16722 ts_tablet_manager.cc:1403] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.158s user 0.019s sys 0.009s
I20260204 08:58:20.556058 16725 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.559617 16532 raft_consensus.cc:2468] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:20.561383 16734 leader_election.cc:290] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
W20260204 08:58:20.560942 16572 leader_election.cc:343] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.562480 16725 tablet_bootstrap.cc:654] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.563463 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:20.563854 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:20.566025 16680 raft_consensus.cc:3060] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.566829 16646 leader_election.cc:304] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:20.568034 16430 catalog_manager.cc:5654] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
W20260204 08:58:20.570451 16647 leader_election.cc:343] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.570896 16722 raft_consensus.cc:359] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.571535 16722 raft_consensus.cc:385] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.571810 16722 raft_consensus.cc:740] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.572472 16722 consensus_queue.cc:260] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.576680 16734 raft_consensus.cc:2804] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.576109 16680 raft_consensus.cc:2468] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:20.579139 16722 ts_tablet_manager.cc:1434] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260204 08:58:20.581352 16734 raft_consensus.cc:697] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:20.581884 16722 tablet_bootstrap.cc:492] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.582176 16734 consensus_queue.cc:237] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.585492 16723 tablet_bootstrap.cc:492] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.585928 16723 ts_tablet_manager.cc:1403] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.081s user 0.011s sys 0.020s
I20260204 08:58:20.588174 16722 tablet_bootstrap.cc:654] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.588874 16572 leader_election.cc:304] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:20.589684 16735 raft_consensus.cc:2804] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.590333 16735 raft_consensus.cc:697] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:20.590721 16749 raft_consensus.cc:493] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.591187 16749 raft_consensus.cc:515] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.592844 16723 raft_consensus.cc:359] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.593526 16723 raft_consensus.cc:385] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.590911 16430 catalog_manager.cc:5654] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:20.593779 16723 raft_consensus.cc:740] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.593736 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2622edd6954367a260d3600443dd26" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.592967 16749 leader_election.cc:290] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.591151 16735 consensus_queue.cc:237] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.594677 16723 consensus_queue.cc:260] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.596350 16607 raft_consensus.cc:2468] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:20.595551 16749 raft_consensus.cc:493] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.599285 16749 raft_consensus.cc:515] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.599682 16498 leader_election.cc:304] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:20.605412 16749 leader_election.cc:290] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.605994 16749 raft_consensus.cc:2804] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.606319 16749 raft_consensus.cc:493] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.606647 16749 raft_consensus.cc:3060] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.608155 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.608464 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2622edd6954367a260d3600443dd26" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.608879 16681 raft_consensus.cc:2468] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:20.609135 16680 raft_consensus.cc:2468] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:20.604249 16773 raft_consensus.cc:493] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.609923 16773 raft_consensus.cc:515] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.614223 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.614696 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.614882 16607 raft_consensus.cc:2468] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.615401 16532 raft_consensus.cc:2468] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.615943 16647 leader_election.cc:304] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:20.616894 16782 raft_consensus.cc:2804] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.617254 16782 raft_consensus.cc:493] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.617558 16782 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.618031 16497 leader_election.cc:304] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:20.612169 16773 leader_election.cc:290] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.624635 16722 tablet_bootstrap.cc:492] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.624994 16722 ts_tablet_manager.cc:1403] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.003s
I20260204 08:58:20.626706 16722 raft_consensus.cc:359] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.627292 16722 raft_consensus.cc:385] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.623374 16749 raft_consensus.cc:515] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.628670 16725 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.630188 16725 ts_tablet_manager.cc:1403] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.074s user 0.011s sys 0.007s
I20260204 08:58:20.630415 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2622edd6954367a260d3600443dd26" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:20.630985 16681 raft_consensus.cc:3060] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.632373 16782 raft_consensus.cc:515] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.633122 16725 raft_consensus.cc:359] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.633769 16725 raft_consensus.cc:385] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.634025 16725 raft_consensus.cc:740] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.627530 16722 raft_consensus.cc:740] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.634636 16725 consensus_queue.cc:260] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.629624 16430 catalog_manager.cc:5654] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:20.657387 16723 ts_tablet_manager.cc:1434] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.071s user 0.007s sys 0.003s
I20260204 08:58:20.634861 16722 consensus_queue.cc:260] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.658936 16723 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.635712 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:20.660343 16532 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.661180 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:20.661731 16607 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.642542 16429 catalog_manager.cc:5654] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:20.662765 16782 leader_election.cc:290] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.667898 16532 raft_consensus.cc:2468] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:20.668254 16681 raft_consensus.cc:2468] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:20.669162 16646 leader_election.cc:304] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:20.629726 16749 leader_election.cc:290] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.669986 16749 raft_consensus.cc:2804] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.670439 16497 leader_election.cc:304] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
W20260204 08:58:20.671310 16498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 71747.3us
I20260204 08:58:20.671680 16607 raft_consensus.cc:2468] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:20.673667 16725 ts_tablet_manager.cc:1434] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.043s user 0.007s sys 0.008s
I20260204 08:58:20.674535 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.675789 16607 raft_consensus.cc:2468] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:20.677037 16725 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.678640 16734 raft_consensus.cc:2804] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.679172 16734 raft_consensus.cc:697] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:20.680037 16734 consensus_queue.cc:237] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.670302 16749 raft_consensus.cc:493] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.683175 16749 raft_consensus.cc:3060] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.684834 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2622edd6954367a260d3600443dd26" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:20.685367 16607 raft_consensus.cc:3060] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.691919 16725 tablet_bootstrap.cc:654] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.693255 16749 raft_consensus.cc:515] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.692198 16607 raft_consensus.cc:2468] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:20.692816 16723 tablet_bootstrap.cc:654] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.695842 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:20.695976 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:20.696388 16606 raft_consensus.cc:3060] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.696511 16681 raft_consensus.cc:3060] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.700608 16794 raft_consensus.cc:2804] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.701077 16794 raft_consensus.cc:697] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:20.701849 16794 consensus_queue.cc:237] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.703321 16606 raft_consensus.cc:2468] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:20.703785 16749 leader_election.cc:290] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.704501 16498 leader_election.cc:304] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:20.703567 16681 raft_consensus.cc:2468] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:20.706669 16749 raft_consensus.cc:2804] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.707145 16749 raft_consensus.cc:697] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:20.707998 16749 consensus_queue.cc:237] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.708840 16723 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.709265 16723 ts_tablet_manager.cc:1403] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.000s
I20260204 08:58:20.711722 16723 raft_consensus.cc:359] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.711328 16430 catalog_manager.cc:5654] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:20.712446 16723 raft_consensus.cc:385] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.718099 16725 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.718701 16725 ts_tablet_manager.cc:1403] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.042s user 0.013s sys 0.001s
I20260204 08:58:20.712769 16723 raft_consensus.cc:740] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.719990 16722 ts_tablet_manager.cc:1434] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.095s user 0.029s sys 0.036s
I20260204 08:58:20.720892 16722 tablet_bootstrap.cc:492] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.721822 16725 raft_consensus.cc:359] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.721948 16723 consensus_queue.cc:260] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.722469 16725 raft_consensus.cc:385] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.722741 16725 raft_consensus.cc:740] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.723587 16725 consensus_queue.cc:260] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.727917 16722 tablet_bootstrap.cc:654] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.730437 16725 ts_tablet_manager.cc:1434] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.011s user 0.003s sys 0.003s
I20260204 08:58:20.731401 16725 tablet_bootstrap.cc:492] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.736176 16723 ts_tablet_manager.cc:1434] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20260204 08:58:20.737128 16725 tablet_bootstrap.cc:654] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.737149 16723 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.758994 16722 tablet_bootstrap.cc:492] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.758224 16428 catalog_manager.cc:5654] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:20.759481 16722 ts_tablet_manager.cc:1403] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.039s user 0.010s sys 0.020s
I20260204 08:58:20.763154 16725 tablet_bootstrap.cc:492] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.763693 16725 ts_tablet_manager.cc:1403] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.007s
I20260204 08:58:20.763624 16722 raft_consensus.cc:359] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.764392 16722 raft_consensus.cc:385] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.764580 16723 tablet_bootstrap.cc:654] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.764669 16722 raft_consensus.cc:740] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.765388 16722 consensus_queue.cc:260] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.766501 16725 raft_consensus.cc:359] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.767174 16725 raft_consensus.cc:385] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.767388 16722 ts_tablet_manager.cc:1434] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260204 08:58:20.767465 16725 raft_consensus.cc:740] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.768291 16722 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.768272 16725 consensus_queue.cc:260] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.770741 16725 ts_tablet_manager.cc:1434] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260204 08:58:20.774420 16722 tablet_bootstrap.cc:654] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.774508 16725 tablet_bootstrap.cc:492] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.781044 16725 tablet_bootstrap.cc:654] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.785368 16722 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.785514 16723 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.785794 16722 ts_tablet_manager.cc:1403] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.000s
I20260204 08:58:20.785869 16723 ts_tablet_manager.cc:1403] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.004s
I20260204 08:58:20.787369 16734 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:20.788623 16722 raft_consensus.cc:359] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.788803 16723 raft_consensus.cc:359] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.789309 16722 raft_consensus.cc:385] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.789399 16723 raft_consensus.cc:385] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.789610 16722 raft_consensus.cc:740] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.789685 16723 raft_consensus.cc:740] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.790249 16722 consensus_queue.cc:260] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.790297 16723 consensus_queue.cc:260] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.793079 16723 ts_tablet_manager.cc:1434] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260204 08:58:20.793079 16722 ts_tablet_manager.cc:1434] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260204 08:58:20.794013 16722 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.794013 16723 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.798105 16428 catalog_manager.cc:5654] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:20.799909 16722 tablet_bootstrap.cc:654] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.799909 16723 tablet_bootstrap.cc:654] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.802414 16779 raft_consensus.cc:493] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.802901 16779 raft_consensus.cc:515] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.804982 16779 leader_election.cc:290] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.806476 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.806689 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:20.807955 16572 leader_election.cc:343] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:20.808640 16572 leader_election.cc:343] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.809019 16572 leader_election.cc:304] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:20.810101 16779 raft_consensus.cc:2749] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:20.812839 16722 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.813280 16722 ts_tablet_manager.cc:1403] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.004s
I20260204 08:58:20.814397 16725 tablet_bootstrap.cc:492] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.816548 16725 ts_tablet_manager.cc:1403] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.042s user 0.011s sys 0.002s
I20260204 08:58:20.815730 16722 raft_consensus.cc:359] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.816953 16722 raft_consensus.cc:385] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.817269 16722 raft_consensus.cc:740] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.817855 16722 consensus_queue.cc:260] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.820122 16722 ts_tablet_manager.cc:1434] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260204 08:58:20.821079 16722 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.819432 16725 raft_consensus.cc:359] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.823076 16725 raft_consensus.cc:385] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.823339 16725 raft_consensus.cc:740] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.824350 16723 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.824107 16725 consensus_queue.cc:260] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.824815 16723 ts_tablet_manager.cc:1403] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.005s
I20260204 08:58:20.826442 16725 ts_tablet_manager.cc:1434] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260204 08:58:20.827241 16722 tablet_bootstrap.cc:654] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.827262 16723 raft_consensus.cc:359] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.828040 16723 raft_consensus.cc:385] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.828297 16723 raft_consensus.cc:740] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.828887 16723 consensus_queue.cc:260] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.830878 16723 ts_tablet_manager.cc:1434] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:58:20.831699 16723 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.837522 16723 tablet_bootstrap.cc:654] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.838335 16722 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.838367 16532 raft_consensus.cc:3060] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.838858 16722 ts_tablet_manager.cc:1403] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.006s
I20260204 08:58:20.841399 16722 raft_consensus.cc:359] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.842046 16722 raft_consensus.cc:385] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.842294 16722 raft_consensus.cc:740] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.842558 16725 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.843041 16722 consensus_queue.cc:260] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.845383 16722 ts_tablet_manager.cc:1434] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260204 08:58:20.847148 16722 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.849423 16725 tablet_bootstrap.cc:654] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.852900 16722 tablet_bootstrap.cc:654] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.860339 16723 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.860901 16723 ts_tablet_manager.cc:1403] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.029s user 0.016s sys 0.011s
I20260204 08:58:20.861104 16782 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:20.863534 16723 raft_consensus.cc:359] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.864269 16723 raft_consensus.cc:385] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.864554 16723 raft_consensus.cc:740] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.865272 16723 consensus_queue.cc:260] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.867738 16723 ts_tablet_manager.cc:1434] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:58:20.868858 16723 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.870507 16725 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.870982 16725 ts_tablet_manager.cc:1403] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.000s
I20260204 08:58:20.873416 16725 raft_consensus.cc:359] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.875486 16723 tablet_bootstrap.cc:654] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.876754 16725 raft_consensus.cc:385] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.877104 16725 raft_consensus.cc:740] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.880208 16722 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.880631 16722 ts_tablet_manager.cc:1403] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.015s
I20260204 08:58:20.879271 16725 consensus_queue.cc:260] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.883081 16722 raft_consensus.cc:359] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.883741 16722 raft_consensus.cc:385] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.884007 16722 raft_consensus.cc:740] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.884694 16722 consensus_queue.cc:260] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.887135 16722 ts_tablet_manager.cc:1434] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260204 08:58:20.888069 16722 tablet_bootstrap.cc:492] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.890717 16725 ts_tablet_manager.cc:1434] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.019s user 0.004s sys 0.002s
I20260204 08:58:20.891631 16725 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.896822 16722 tablet_bootstrap.cc:654] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.897841 16794 raft_consensus.cc:493] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.898322 16794 raft_consensus.cc:515] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.898823 16725 tablet_bootstrap.cc:654] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:20.900322 16794 leader_election.cc:290] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.901424 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d0dd5730ea04490876711f04afa95e5" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.901777 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d0dd5730ea04490876711f04afa95e5" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.902038 16681 raft_consensus.cc:2468] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
W20260204 08:58:20.902881 16498 leader_election.cc:343] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.903378 16497 leader_election.cc:304] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:20.904130 16723 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:20.904239 16794 raft_consensus.cc:2804] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.904583 16723 ts_tablet_manager.cc:1403] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.019s
I20260204 08:58:20.904575 16794 raft_consensus.cc:493] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.904990 16794 raft_consensus.cc:3060] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.907409 16723 raft_consensus.cc:359] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.908088 16723 raft_consensus.cc:385] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.908330 16723 raft_consensus.cc:740] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.908664 16749 raft_consensus.cc:493] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.909076 16749 raft_consensus.cc:515] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.911561 16779 raft_consensus.cc:493] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.912017 16779 raft_consensus.cc:515] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.912672 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.913797 16779 leader_election.cc:290] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.914498 16749 leader_election.cc:290] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.915421 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.916200 16531 raft_consensus.cc:2393] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f959652a42f34a81aca5da9faec0a7a3 in current term 1: Already voted for candidate 86e16045049f4f87a94336b5d2262328 in this term.
I20260204 08:58:20.917867 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.918581 16680 raft_consensus.cc:2393] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35380a227e2c4fa4a063d4fd67c30b53 in current term 1: Already voted for candidate f959652a42f34a81aca5da9faec0a7a3 in this term.
I20260204 08:58:20.919366 16794 raft_consensus.cc:515] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.919552 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.920981 16681 raft_consensus.cc:3060] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.922921 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d0dd5730ea04490876711f04afa95e5" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
W20260204 08:58:20.924086 16498 leader_election.cc:343] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.925218 16794 leader_election.cc:290] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.928819 16497 leader_election.cc:304] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:20.929558 16722 tablet_bootstrap.cc:492] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:20.929994 16572 leader_election.cc:304] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:20.930116 16722 ts_tablet_manager.cc:1403] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.042s user 0.014s sys 0.000s
I20260204 08:58:20.930130 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d0dd5730ea04490876711f04afa95e5" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:20.930830 16679 raft_consensus.cc:3060] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.931022 16779 raft_consensus.cc:3060] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.935549 16725 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:20.936038 16725 ts_tablet_manager.cc:1403] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.045s user 0.027s sys 0.014s
I20260204 08:58:20.937563 16779 raft_consensus.cc:2749] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:20.937783 16679 raft_consensus.cc:2468] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:20.909008 16723 consensus_queue.cc:260] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.938817 16497 leader_election.cc:304] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:20.938637 16725 raft_consensus.cc:359] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.947824 16725 raft_consensus.cc:385] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.942363 16794 raft_consensus.cc:3060] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.948128 16725 raft_consensus.cc:740] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.948770 16725 consensus_queue.cc:260] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.950810 16725 ts_tablet_manager.cc:1434] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260204 08:58:20.942934 16679 raft_consensus.cc:3060] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.943264 16749 raft_consensus.cc:2804] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:20.954397 16794 raft_consensus.cc:2749] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:20.956378 16749 raft_consensus.cc:697] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:20.944208 16796 raft_consensus.cc:493] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.957494 16796 raft_consensus.cc:515] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.957818 16749 consensus_queue.cc:237] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.940784 16723 ts_tablet_manager.cc:1434] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.036s user 0.004s sys 0.002s
I20260204 08:58:20.956983 16782 raft_consensus.cc:493] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.951691 16725 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:20.960920 16723 tablet_bootstrap.cc:492] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:20.943591 16722 raft_consensus.cc:359] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.961412 16722 raft_consensus.cc:385] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:20.960214 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.962450 16606 raft_consensus.cc:2468] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:20.959512 16796 leader_election.cc:290] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:20.961673 16722 raft_consensus.cc:740] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:20.964279 16498 leader_election.cc:304] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:20.968245 16722 consensus_queue.cc:260] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.968560 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:20.959383 16779 consensus_queue.cc:1048] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260204 08:58:20.970337 16497 leader_election.cc:343] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.970507 16819 raft_consensus.cc:2804] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.970772 16722 ts_tablet_manager.cc:1434] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.040s user 0.009s sys 0.009s
I20260204 08:58:20.971764 16773 raft_consensus.cc:493] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:20.960098 16782 raft_consensus.cc:515] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.972225 16773 raft_consensus.cc:515] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:20.973865 16773 leader_election.cc:290] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.971761 16722 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:20.976192 16819 raft_consensus.cc:493] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.976544 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f175f5811e74a91b26e6ac39bc9d0b7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.977018 16782 leader_election.cc:290] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:20.977186 16531 raft_consensus.cc:2468] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.976732 16819 raft_consensus.cc:3060] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.978235 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:20.979031 16646 leader_election.cc:304] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:20.979598 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.981133 16606 raft_consensus.cc:2468] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.978222 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f175f5811e74a91b26e6ac39bc9d0b7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:20.982461 16532 raft_consensus.cc:2468] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:20.981235 16773 raft_consensus.cc:2804] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.983768 16773 raft_consensus.cc:493] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.984102 16773 raft_consensus.cc:3060] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.987916 16646 leader_election.cc:304] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
W20260204 08:58:20.989578 16647 leader_election.cc:343] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:20.996728 16772 consensus_queue.cc:1048] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:20.997291 16782 raft_consensus.cc:2804] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:20.997668 16782 raft_consensus.cc:493] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:20.998018 16782 raft_consensus.cc:3060] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:20.987346 16819 raft_consensus.cc:515] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.008638 16779 consensus_queue.cc:1048] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:21.010223 16746 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260204 08:58:21.021202 16819 leader_election.cc:290] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.028282 16725 tablet_bootstrap.cc:654] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.027729 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:21.026887 16773 raft_consensus.cc:515] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.035789 16734 raft_consensus.cc:493] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:58:21.035944 16497 leader_election.cc:343] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.036316 16734 raft_consensus.cc:515] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.038203 16734 leader_election.cc:290] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:21.039851 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:21.040565 16605 raft_consensus.cc:3060] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.039095 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:21.044207 16529 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.045075 16782 raft_consensus.cc:515] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.052188 16723 tablet_bootstrap.cc:654] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.053454 16782 leader_election.cc:290] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:21.053066 16734 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260204 08:58:21.068543 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f175f5811e74a91b26e6ac39bc9d0b7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:21.069191 16531 raft_consensus.cc:3060] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.061861 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.075213 16605 raft_consensus.cc:2468] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
W20260204 08:58:21.075452 16646 leader_election.cc:343] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.076380 16722 tablet_bootstrap.cc:654] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
W20260204 08:58:21.076210 16647 leader_election.cc:343] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.076217 16498 leader_election.cc:304] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:21.077730 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:21.077904 16749 raft_consensus.cc:2804] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:21.078341 16530 raft_consensus.cc:3060] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.078397 16749 raft_consensus.cc:697] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:21.080418 16430 catalog_manager.cc:5654] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:21.093062 16779 consensus_queue.cc:1048] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:21.086320 16749 consensus_queue.cc:237] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.095733 16647 leader_election.cc:304] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:21.097389 16746 raft_consensus.cc:2749] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:21.066623 16782 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260204 08:58:21.102299 16822 log.cc:927] Time spent T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328: Append to log took a long time: real 0.052s user 0.001s sys 0.000s
I20260204 08:58:21.114414 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:21.115067 16606 raft_consensus.cc:3060] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.100399 16773 leader_election.cc:290] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:21.130028 16779 raft_consensus.cc:493] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.130545 16779 raft_consensus.cc:515] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.132530 16779 leader_election.cc:290] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.133473 16782 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:58:21.138932 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72c4736a5d244206a366cb1166df369e" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:21.140592 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f175f5811e74a91b26e6ac39bc9d0b7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:21.141212 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72c4736a5d244206a366cb1166df369e" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:21.141908 16647 leader_election.cc:343] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.150203 16531 raft_consensus.cc:2468] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
W20260204 08:58:21.144805 16572 leader_election.cc:343] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.161407 16725 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:21.155336 16646 leader_election.cc:304] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:21.157666 16722 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:21.177163 16722 ts_tablet_manager.cc:1403] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.206s user 0.017s sys 0.032s
I20260204 08:58:21.177591 16725 ts_tablet_manager.cc:1403] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.226s user 0.020s sys 0.026s
I20260204 08:58:21.174190 16779 consensus_queue.cc:1048] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260204 08:58:21.198943 16725 raft_consensus.cc:359] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:21.191617 16572 leader_election.cc:343] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.199615 16725 raft_consensus.cc:385] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.202082 16572 leader_election.cc:304] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:21.202494 16725 raft_consensus.cc:740] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.203260 16772 raft_consensus.cc:2749] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:21.203245 16725 consensus_queue.cc:260] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.191120 16773 raft_consensus.cc:2804] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:21.201783 16530 raft_consensus.cc:2468] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:21.210175 16725 ts_tablet_manager.cc:1434] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.032s user 0.006s sys 0.001s
I20260204 08:58:21.211433 16749 consensus_queue.cc:1048] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:21.210449 16773 raft_consensus.cc:697] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:21.216269 16725 tablet_bootstrap.cc:492] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:21.215934 16782 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260204 08:58:21.215986 16772 consensus_queue.cc:1048] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260204 08:58:21.213781 16606 raft_consensus.cc:2468] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:21.220238 16773 consensus_queue.cc:237] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.230190 16647 leader_election.cc:304] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:21.231210 16782 raft_consensus.cc:2804] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:21.231781 16782 raft_consensus.cc:697] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:21.232582 16782 consensus_queue.cc:237] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.231101 16722 raft_consensus.cc:359] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.233969 16722 raft_consensus.cc:385] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.234234 16722 raft_consensus.cc:740] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.236625 16722 consensus_queue.cc:260] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.239420 16746 raft_consensus.cc:493] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.240660 16746 raft_consensus.cc:515] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.246665 16746 leader_election.cc:290] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:21.248545 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "147ea8d1b63e4e9e8f084676f3f0ea12" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:21.249219 16532 raft_consensus.cc:2468] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:21.250378 16646 leader_election.cc:304] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:21.254616 16777 raft_consensus.cc:2804] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:21.255003 16777 raft_consensus.cc:493] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:21.255321 16777 raft_consensus.cc:3060] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.265362 16796 consensus_queue.cc:1048] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:21.269173 16796 consensus_queue.cc:1048] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260204 08:58:21.287115 16723 tablet_bootstrap.cc:492] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:21.287673 16723 ts_tablet_manager.cc:1403] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.327s user 0.022s sys 0.014s
I20260204 08:58:21.292460 16779 raft_consensus.cc:493] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:58:21.298328 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:58:21.305507 16429 catalog_manager.cc:5654] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:21.296407 16779 raft_consensus.cc:515] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.308619 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "147ea8d1b63e4e9e8f084676f3f0ea12" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.310168 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:21.321478 16722 ts_tablet_manager.cc:1434] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.143s user 0.007s sys 0.003s
I20260204 08:58:21.322600 16722 tablet_bootstrap.cc:492] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
W20260204 08:58:21.320384 16647 leader_election.cc:343] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:21.320442 16572 leader_election.cc:343] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.372133 16779 leader_election.cc:290] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.372947 16777 raft_consensus.cc:515] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.385910 16722 tablet_bootstrap.cc:654] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.387121 16777 leader_election.cc:290] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:21.387638 16723 raft_consensus.cc:359] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.388484 16723 raft_consensus.cc:385] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.388818 16723 raft_consensus.cc:740] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.389577 16723 consensus_queue.cc:260] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.398021 16723 ts_tablet_manager.cc:1434] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.110s user 0.006s sys 0.000s
I20260204 08:58:21.398998 16723 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:21.379398 16734 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260204 08:58:21.375805 16647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 55694.4us
I20260204 08:58:21.409543 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "147ea8d1b63e4e9e8f084676f3f0ea12" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:21.410215 16532 raft_consensus.cc:3060] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.420538 16819 raft_consensus.cc:493] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f959652a42f34a81aca5da9faec0a7a3)
W20260204 08:58:21.421217 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 103693us
I20260204 08:58:21.421065 16819 raft_consensus.cc:515] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.418972 16749 consensus_queue.cc:1048] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260204 08:58:21.439589 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "147ea8d1b63e4e9e8f084676f3f0ea12" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:21.460976 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:21.475347 16647 leader_election.cc:343] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.476431 16819 leader_election.cc:290] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.490067 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
W20260204 08:58:21.494406 16498 consensus_peers.cc:597] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:21.497339 16723 tablet_bootstrap.cc:654] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
W20260204 08:58:21.496093 16572 leader_election.cc:343] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.505381 16725 tablet_bootstrap.cc:654] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.506655 16572 leader_election.cc:304] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:21.507387 16735 raft_consensus.cc:2749] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:21.500315 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:21.508996 16532 raft_consensus.cc:2468] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:21.508945 16497 leader_election.cc:304] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:21.509764 16794 raft_consensus.cc:2749] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:21.510274 16646 leader_election.cc:304] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:21.511297 16773 raft_consensus.cc:2804] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:21.511813 16773 raft_consensus.cc:697] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:21.513329 16773 consensus_queue.cc:237] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:21.515466 16835 log.cc:927] Time spent T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3: Append to log took a long time: real 0.051s user 0.002s sys 0.000s
I20260204 08:58:21.515381 16428 catalog_manager.cc:5654] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:21.521802 16428 catalog_manager.cc:5654] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
W20260204 08:58:21.541512 16497 consensus_peers.cc:597] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:21.543537 16794 consensus_queue.cc:1048] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:58:21.561232 16847 log.cc:927] Time spent T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260204 08:58:21.561334 16846 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260204 08:58:21.568681 16722 tablet_bootstrap.cc:492] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:21.582270 16725 tablet_bootstrap.cc:492] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:21.582407 16722 ts_tablet_manager.cc:1403] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.260s user 0.020s sys 0.022s
I20260204 08:58:21.582743 16725 ts_tablet_manager.cc:1403] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.369s user 0.013s sys 0.018s
I20260204 08:58:21.585264 16430 catalog_manager.cc:5654] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:21.593344 16723 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:21.593139 16725 raft_consensus.cc:359] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.593724 16723 ts_tablet_manager.cc:1403] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.195s user 0.014s sys 0.001s
I20260204 08:58:21.595674 16722 raft_consensus.cc:359] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.596313 16722 raft_consensus.cc:385] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.596583 16722 raft_consensus.cc:740] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.596666 16723 raft_consensus.cc:359] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.597437 16723 raft_consensus.cc:385] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.597198 16722 consensus_queue.cc:260] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.597723 16723 raft_consensus.cc:740] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.598443 16723 consensus_queue.cc:260] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.599193 16722 ts_tablet_manager.cc:1434] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260204 08:58:21.600121 16722 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:21.603823 16725 raft_consensus.cc:385] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.604122 16725 raft_consensus.cc:740] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.604339 16723 ts_tablet_manager.cc:1434] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260204 08:58:21.604714 16725 consensus_queue.cc:260] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.605337 16723 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:21.606793 16725 ts_tablet_manager.cc:1434] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
I20260204 08:58:21.607687 16725 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:21.611526 16723 tablet_bootstrap.cc:654] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.612919 16725 tablet_bootstrap.cc:654] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.614305 16722 tablet_bootstrap.cc:654] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.627316 16723 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:21.627806 16723 ts_tablet_manager.cc:1403] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.023s user 0.015s sys 0.002s
I20260204 08:58:21.633735 16723 raft_consensus.cc:359] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.634405 16723 raft_consensus.cc:385] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.634668 16723 raft_consensus.cc:740] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.635241 16723 consensus_queue.cc:260] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.638653 16725 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:21.639117 16723 ts_tablet_manager.cc:1434] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260204 08:58:21.639189 16725 ts_tablet_manager.cc:1403] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.032s user 0.023s sys 0.007s
I20260204 08:58:21.639868 16722 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:21.640276 16722 ts_tablet_manager.cc:1403] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.012s
I20260204 08:58:21.640959 16723 tablet_bootstrap.cc:492] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:21.642663 16722 raft_consensus.cc:359] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.643282 16722 raft_consensus.cc:385] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.643568 16722 raft_consensus.cc:740] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.644161 16722 consensus_queue.cc:260] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.646368 16722 ts_tablet_manager.cc:1434] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:58:21.647251 16722 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:21.648694 16723 tablet_bootstrap.cc:654] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.653297 16722 tablet_bootstrap.cc:654] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.641757 16725 raft_consensus.cc:359] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.656827 16725 raft_consensus.cc:385] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.657124 16725 raft_consensus.cc:740] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.657809 16725 consensus_queue.cc:260] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.659932 16725 ts_tablet_manager.cc:1434] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260204 08:58:21.660789 16725 tablet_bootstrap.cc:492] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:21.666110 16723 tablet_bootstrap.cc:492] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:21.666584 16723 ts_tablet_manager.cc:1403] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.009s
I20260204 08:58:21.666690 16725 tablet_bootstrap.cc:654] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.668139 16722 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:21.668591 16722 ts_tablet_manager.cc:1403] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.000s
I20260204 08:58:21.669028 16723 raft_consensus.cc:359] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.669694 16723 raft_consensus.cc:385] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.669953 16723 raft_consensus.cc:740] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.670738 16723 consensus_queue.cc:260] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.671310 16722 raft_consensus.cc:359] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.672160 16722 raft_consensus.cc:385] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.672447 16722 raft_consensus.cc:740] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.673043 16723 ts_tablet_manager.cc:1434] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:58:21.673167 16722 consensus_queue.cc:260] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.674304 16723 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:21.674870 16722 ts_tablet_manager.cc:1434] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:58:21.675776 16722 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:21.680684 16723 tablet_bootstrap.cc:654] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.682075 16722 tablet_bootstrap.cc:654] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.682727 16734 consensus_queue.cc:1048] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:21.688604 16725 tablet_bootstrap.cc:492] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:21.689096 16725 ts_tablet_manager.cc:1403] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.005s
I20260204 08:58:21.691430 16725 raft_consensus.cc:359] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.692085 16725 raft_consensus.cc:385] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.692344 16725 raft_consensus.cc:740] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.693166 16725 consensus_queue.cc:260] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.693924 16734 raft_consensus.cc:493] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.694324 16734 raft_consensus.cc:515] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.696661 16734 leader_election.cc:290] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:21.697204 16722 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:21.697628 16722 ts_tablet_manager.cc:1403] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.000s
I20260204 08:58:21.697721 16734 raft_consensus.cc:493] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.698179 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:21.698371 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.698168 16734 raft_consensus.cc:515] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:21.699595 16646 leader_election.cc:343] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.700106 16725 ts_tablet_manager.cc:1434] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20260204 08:58:21.700691 16734 leader_election.cc:290] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
W20260204 08:58:21.700816 16647 leader_election.cc:343] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.701056 16725 tablet_bootstrap.cc:492] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:21.701432 16647 leader_election.cc:304] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:21.702553 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:21.703284 16734 raft_consensus.cc:2749] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:21.703344 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.704373 16846 raft_consensus.cc:493] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.704825 16846 raft_consensus.cc:515] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.705226 16647 leader_election.cc:304] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:21.706239 16734 raft_consensus.cc:2749] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:21.706825 16846 leader_election.cc:290] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.707405 16725 tablet_bootstrap.cc:654] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.707338 16722 raft_consensus.cc:359] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.708096 16722 raft_consensus.cc:385] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.708375 16722 raft_consensus.cc:740] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.708722 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29067ae5902a405283277bb95a626f04" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:21.709371 16678 raft_consensus.cc:2468] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:21.710605 16497 leader_election.cc:304] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:21.712145 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29067ae5902a405283277bb95a626f04" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.712803 16602 raft_consensus.cc:2468] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:21.712590 16722 consensus_queue.cc:260] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.713618 16794 raft_consensus.cc:2804] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:21.713874 16723 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:21.714028 16794 raft_consensus.cc:493] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:21.714322 16723 ts_tablet_manager.cc:1403] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.040s user 0.016s sys 0.010s
I20260204 08:58:21.714406 16794 raft_consensus.cc:3060] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.714756 16722 ts_tablet_manager.cc:1434] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260204 08:58:21.715430 16722 tablet_bootstrap.cc:492] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:21.717371 16723 raft_consensus.cc:359] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.717985 16723 raft_consensus.cc:385] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.718226 16723 raft_consensus.cc:740] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.718974 16723 consensus_queue.cc:260] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.721184 16722 tablet_bootstrap.cc:654] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.724807 16794 raft_consensus.cc:515] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.726781 16794 leader_election.cc:290] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.728720 16723 ts_tablet_manager.cc:1434] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260204 08:58:21.729689 16723 tablet_bootstrap.cc:492] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:21.733899 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29067ae5902a405283277bb95a626f04" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:21.734558 16678 raft_consensus.cc:3060] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.734699 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29067ae5902a405283277bb95a626f04" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:21.735317 16602 raft_consensus.cc:3060] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.747397 16605 raft_consensus.cc:3060] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.755800 16794 raft_consensus.cc:493] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.756399 16794 raft_consensus.cc:515] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.758234 16794 leader_election.cc:290] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.759765 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72c4736a5d244206a366cb1166df369e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:21.761245 16497 leader_election.cc:343] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.761727 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72c4736a5d244206a366cb1166df369e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.762936 16603 raft_consensus.cc:2468] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:21.764196 16498 leader_election.cc:304] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:21.765512 16794 raft_consensus.cc:2804] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:21.765946 16794 raft_consensus.cc:493] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:21.766353 16794 raft_consensus.cc:3060] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.773589 16602 raft_consensus.cc:2468] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:21.780541 16734 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:21.781219 16498 leader_election.cc:304] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:21.782873 16849 raft_consensus.cc:2804] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:21.783399 16849 raft_consensus.cc:697] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:21.784294 16849 consensus_queue.cc:237] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.774628 16846 raft_consensus.cc:493] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.788555 16846 raft_consensus.cc:515] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.790606 16846 leader_election.cc:290] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.779749 16678 raft_consensus.cc:2468] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:21.792338 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:21.794427 16734 consensus_queue.cc:1048] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:58:21.796298 16497 leader_election.cc:343] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.796885 16794 raft_consensus.cc:515] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.799916 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72c4736a5d244206a366cb1166df369e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:21.800266 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.800590 16603 raft_consensus.cc:3060] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.799414 16794 leader_election.cc:290] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.800756 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72c4736a5d244206a366cb1166df369e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
W20260204 08:58:21.803774 16498 leader_election.cc:343] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.804471 16498 leader_election.cc:304] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:21.805486 16723 tablet_bootstrap.cc:654] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.807063 16603 raft_consensus.cc:2468] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
W20260204 08:58:21.807240 16497 leader_election.cc:343] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.807416 16725 tablet_bootstrap.cc:492] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:21.808081 16725 ts_tablet_manager.cc:1403] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.107s user 0.031s sys 0.053s
I20260204 08:58:21.808754 16794 raft_consensus.cc:2749] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:21.809311 16498 leader_election.cc:304] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:21.812172 16722 tablet_bootstrap.cc:492] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:21.812590 16722 ts_tablet_manager.cc:1403] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.097s user 0.006s sys 0.082s
I20260204 08:58:21.812825 16725 raft_consensus.cc:359] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.813452 16725 raft_consensus.cc:385] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.813699 16725 raft_consensus.cc:740] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.813856 16849 raft_consensus.cc:2804] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:21.814321 16725 consensus_queue.cc:260] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.814963 16722 raft_consensus.cc:359] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.815405 16849 raft_consensus.cc:697] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:21.815582 16722 raft_consensus.cc:385] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.815923 16722 raft_consensus.cc:740] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.817812 16725 ts_tablet_manager.cc:1434] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260204 08:58:21.816542 16722 consensus_queue.cc:260] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.818715 16725 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:21.816324 16849 consensus_queue.cc:237] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.829916 16426 catalog_manager.cc:5654] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:21.835093 16722 ts_tablet_manager.cc:1434] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.022s user 0.004s sys 0.002s
I20260204 08:58:21.836663 16722 tablet_bootstrap.cc:492] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:21.838811 16794 raft_consensus.cc:493] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.839313 16794 raft_consensus.cc:515] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.842924 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:21.843565 16679 raft_consensus.cc:2468] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:21.844310 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.844842 16497 leader_election.cc:304] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
W20260204 08:58:21.845631 16498 leader_election.cc:343] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.845775 16846 raft_consensus.cc:2804] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:21.846186 16846 raft_consensus.cc:493] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:21.846565 16846 raft_consensus.cc:3060] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.848295 16722 tablet_bootstrap.cc:654] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.851742 16794 leader_election.cc:290] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.855840 16846 raft_consensus.cc:515] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.858932 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:21.859087 16734 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:21.859513 16679 raft_consensus.cc:3060] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.861109 16722 tablet_bootstrap.cc:492] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:21.861616 16722 ts_tablet_manager.cc:1403] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.001s
I20260204 08:58:21.862141 16725 tablet_bootstrap.cc:654] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.863931 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
W20260204 08:58:21.868330 16498 leader_election.cc:343] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.867686 16846 leader_election.cc:290] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.877413 16722 raft_consensus.cc:359] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.878194 16722 raft_consensus.cc:385] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.878473 16722 raft_consensus.cc:740] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.879079 16722 consensus_queue.cc:260] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.881167 16722 ts_tablet_manager.cc:1434] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.019s user 0.003s sys 0.003s
I20260204 08:58:21.882031 16722 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:21.874603 16679 raft_consensus.cc:2468] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:21.892038 16497 leader_election.cc:304] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:21.894402 16849 raft_consensus.cc:2804] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:21.901808 16723 tablet_bootstrap.cc:492] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:21.901733 16849 raft_consensus.cc:697] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:21.902328 16723 ts_tablet_manager.cc:1403] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.173s user 0.008s sys 0.011s
I20260204 08:58:21.902765 16849 consensus_queue.cc:237] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.904834 16844 raft_consensus.cc:493] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.904918 16723 raft_consensus.cc:359] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.905340 16844 raft_consensus.cc:515] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.905666 16723 raft_consensus.cc:385] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.907186 16723 raft_consensus.cc:740] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.907965 16725 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:21.907869 16723 consensus_queue.cc:260] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.908375 16725 ts_tablet_manager.cc:1403] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.090s user 0.010s sys 0.014s
I20260204 08:58:21.909723 16844 leader_election.cc:290] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:21.911397 16723 ts_tablet_manager.cc:1434] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260204 08:58:21.912124 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "deb06db695bc4cd7bcef0b6d5f27c3e3" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:21.912400 16723 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:21.915768 16603 raft_consensus.cc:2468] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:21.915884 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "deb06db695bc4cd7bcef0b6d5f27c3e3" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:21.916504 16526 raft_consensus.cc:2468] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:21.917457 16647 leader_election.cc:304] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:21.910998 16427 catalog_manager.cc:5654] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:21.918228 16746 raft_consensus.cc:2804] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:21.921505 16746 raft_consensus.cc:493] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:21.921830 16746 raft_consensus.cc:3060] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.922926 16773 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260204 08:58:21.923038 16725 raft_consensus.cc:359] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.927301 16725 raft_consensus.cc:385] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.927726 16725 raft_consensus.cc:740] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.928320 16725 consensus_queue.cc:260] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.926967 16723 tablet_bootstrap.cc:654] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.929483 16746 raft_consensus.cc:515] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.932253 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "deb06db695bc4cd7bcef0b6d5f27c3e3" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:21.932825 16532 raft_consensus.cc:3060] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.932991 16725 ts_tablet_manager.cc:1434] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.024s user 0.005s sys 0.001s
I20260204 08:58:21.934013 16725 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:21.939982 16725 tablet_bootstrap.cc:654] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.941385 16735 raft_consensus.cc:493] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.941834 16735 raft_consensus.cc:515] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.942706 16532 raft_consensus.cc:2468] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:21.943845 16646 leader_election.cc:304] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:21.944692 16844 raft_consensus.cc:2804] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:21.945149 16844 raft_consensus.cc:697] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:21.946918 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d0dd5730ea04490876711f04afa95e5" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:21.948951 16779 raft_consensus.cc:493] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:21.949378 16779 raft_consensus.cc:515] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.951205 16779 leader_election.cc:290] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.945955 16844 consensus_queue.cc:237] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.953821 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:21.955448 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:21.957041 16572 leader_election.cc:343] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:21.957643 16572 leader_election.cc:343] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:21.958552 16572 leader_election.cc:304] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:21.959995 16779 raft_consensus.cc:2749] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:21.960634 16735 leader_election.cc:290] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:21.945885 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d0dd5730ea04490876711f04afa95e5" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:21.961992 16746 leader_election.cc:290] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:21.917686 16722 tablet_bootstrap.cc:654] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.963107 16572 leader_election.cc:304] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:21.964195 16735 raft_consensus.cc:2749] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:21.968743 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "deb06db695bc4cd7bcef0b6d5f27c3e3" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:21.969306 16603 raft_consensus.cc:3060] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.976274 16723 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:21.976792 16723 ts_tablet_manager.cc:1403] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.023s
I20260204 08:58:21.977149 16603 raft_consensus.cc:2468] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:21.979635 16722 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:21.979310 16723 raft_consensus.cc:359] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.979980 16723 raft_consensus.cc:385] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.980074 16722 ts_tablet_manager.cc:1403] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.098s user 0.011s sys 0.001s
I20260204 08:58:21.980248 16723 raft_consensus.cc:740] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.981369 16723 consensus_queue.cc:260] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.982594 16722 raft_consensus.cc:359] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.983978 16723 ts_tablet_manager.cc:1434] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260204 08:58:21.983978 16722 raft_consensus.cc:385] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.984390 16722 raft_consensus.cc:740] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.984920 16723 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:21.985035 16722 consensus_queue.cc:260] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.987304 16722 ts_tablet_manager.cc:1434] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260204 08:58:21.987886 16725 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:21.988238 16722 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:21.988301 16725 ts_tablet_manager.cc:1403] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.054s user 0.015s sys 0.008s
I20260204 08:58:21.989940 16430 catalog_manager.cc:5654] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:21.988492 16427 catalog_manager.cc:5654] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:21.991263 16725 raft_consensus.cc:359] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.991979 16725 raft_consensus.cc:385] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:21.992240 16725 raft_consensus.cc:740] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:21.992838 16725 consensus_queue.cc:260] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:21.993757 16723 tablet_bootstrap.cc:654] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:21.994850 16725 ts_tablet_manager.cc:1434] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:58:21.976255 16605 raft_consensus.cc:3060] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:21.998049 16603 raft_consensus.cc:3060] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.000974 16722 tablet_bootstrap.cc:654] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.004144 16679 raft_consensus.cc:3060] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.015585 16725 tablet_bootstrap.cc:492] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.015717 16844 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.019956 16723 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.020404 16723 ts_tablet_manager.cc:1403] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.036s user 0.010s sys 0.006s
I20260204 08:58:22.022722 16723 raft_consensus.cc:359] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.023334 16723 raft_consensus.cc:385] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.023571 16723 raft_consensus.cc:740] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.024401 16723 consensus_queue.cc:260] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.026548 16723 ts_tablet_manager.cc:1434] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:58:22.027601 16723 tablet_bootstrap.cc:492] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.046434 16725 tablet_bootstrap.cc:654] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.046998 16723 tablet_bootstrap.cc:654] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.055935 16722 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:22.056542 16722 ts_tablet_manager.cc:1403] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.001s
I20260204 08:58:22.059226 16722 raft_consensus.cc:359] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.060115 16722 raft_consensus.cc:385] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.060441 16722 raft_consensus.cc:740] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.061232 16722 consensus_queue.cc:260] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.063344 16722 ts_tablet_manager.cc:1434] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:58:22.064899 16722 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:22.076848 16725 tablet_bootstrap.cc:492] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:22.077239 16725 ts_tablet_manager.cc:1403] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.082s user 0.006s sys 0.008s
I20260204 08:58:22.080291 16794 raft_consensus.cc:493] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.080752 16794 raft_consensus.cc:515] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.081920 16725 raft_consensus.cc:359] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.082530 16725 raft_consensus.cc:385] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.082789 16725 raft_consensus.cc:740] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.084014 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be0afba4e5c14c95870971bc8c2c7225" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.083416 16725 consensus_queue.cc:260] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:22.085299 16498 leader_election.cc:343] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.087577 16722 tablet_bootstrap.cc:654] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.091905 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be0afba4e5c14c95870971bc8c2c7225" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.092490 16679 raft_consensus.cc:2468] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.092893 16725 ts_tablet_manager.cc:1434] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20260204 08:58:22.093457 16497 leader_election.cc:304] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:22.093832 16725 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.094311 16846 raft_consensus.cc:2804] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.094646 16846 raft_consensus.cc:493] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.094990 16846 raft_consensus.cc:3060] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.082718 16794 leader_election.cc:290] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.093106 16723 tablet_bootstrap.cc:492] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.098165 16723 ts_tablet_manager.cc:1403] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.071s user 0.016s sys 0.012s
I20260204 08:58:22.100168 16794 raft_consensus.cc:493] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.100584 16723 raft_consensus.cc:359] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.100728 16846 raft_consensus.cc:515] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.101272 16723 raft_consensus.cc:385] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.100683 16794 raft_consensus.cc:515] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.101576 16723 raft_consensus.cc:740] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.103024 16723 consensus_queue.cc:260] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.103464 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.105980 16723 ts_tablet_manager.cc:1434] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260204 08:58:22.106842 16723 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
W20260204 08:58:22.105545 16498 leader_election.cc:343] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.109858 16725 tablet_bootstrap.cc:654] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.112114 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.112388 16779 raft_consensus.cc:493] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.112847 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be0afba4e5c14c95870971bc8c2c7225" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:22.113272 16679 raft_consensus.cc:2468] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.112857 16779 raft_consensus.cc:515] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.114288 16497 leader_election.cc:304] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:22.115010 16849 raft_consensus.cc:2804] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.115341 16849 raft_consensus.cc:493] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 08:58:22.115880 16498 leader_election.cc:343] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.115974 16849 raft_consensus.cc:3060] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.116210 16779 leader_election.cc:290] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.118331 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.118297 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.119127 16679 raft_consensus.cc:2393] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f959652a42f34a81aca5da9faec0a7a3 in current term 1: Already voted for candidate 35380a227e2c4fa4a063d4fd67c30b53 in this term.
I20260204 08:58:22.120210 16572 leader_election.cc:304] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:22.121557 16735 raft_consensus.cc:3060] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.115614 16794 leader_election.cc:290] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.123759 16849 raft_consensus.cc:515] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.124033 16846 leader_election.cc:290] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.127254 16849 leader_election.cc:290] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.127233 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
W20260204 08:58:22.128500 16498 leader_election.cc:343] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.130263 16723 tablet_bootstrap.cc:654] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.133270 16735 raft_consensus.cc:2749] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:22.137948 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be0afba4e5c14c95870971bc8c2c7225" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:22.138376 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:22.138484 16679 raft_consensus.cc:3060] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.138854 16678 raft_consensus.cc:3060] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.138957 16723 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.139624 16723 ts_tablet_manager.cc:1403] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.002s
I20260204 08:58:22.143704 16723 raft_consensus.cc:359] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.144578 16723 raft_consensus.cc:385] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.144665 16679 raft_consensus.cc:2468] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:22.145090 16723 raft_consensus.cc:740] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.145823 16497 leader_election.cc:304] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:22.146075 16723 consensus_queue.cc:260] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.146409 16678 raft_consensus.cc:2468] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:22.147120 16849 raft_consensus.cc:2804] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.147617 16849 raft_consensus.cc:697] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:22.148428 16849 consensus_queue.cc:237] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.149559 16723 ts_tablet_manager.cc:1434] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.010s user 0.003s sys 0.004s
I20260204 08:58:22.150974 16723 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.161093 16723 tablet_bootstrap.cc:654] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.165444 16497 leader_election.cc:304] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:22.166011 16427 catalog_manager.cc:5654] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:22.167900 16849 raft_consensus.cc:2804] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.171118 16779 raft_consensus.cc:493] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.171208 16849 raft_consensus.cc:697] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:22.171680 16779 raft_consensus.cc:515] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.174969 16779 leader_election.cc:290] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.173477 16846 consensus_queue.cc:1048] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260204 08:58:22.178622 16722 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:22.179124 16722 ts_tablet_manager.cc:1403] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.115s user 0.013s sys 0.001s
I20260204 08:58:22.180408 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "326778f65c8845f5bc8e4a236d093bfe" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.184994 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "326778f65c8845f5bc8e4a236d093bfe" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.186056 16849 consensus_queue.cc:237] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:22.190728 16572 leader_election.cc:343] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:22.191473 16572 leader_election.cc:343] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.191877 16572 leader_election.cc:304] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:22.193048 16735 raft_consensus.cc:493] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.193509 16735 raft_consensus.cc:515] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.195326 16735 leader_election.cc:290] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.195788 16779 raft_consensus.cc:2749] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:22.198127 16722 raft_consensus.cc:359] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.198809 16722 raft_consensus.cc:385] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.199070 16722 raft_consensus.cc:740] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.199716 16722 consensus_queue.cc:260] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.205406 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa4d147d1fb14e6ca905000e39085dfa" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.206812 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa4d147d1fb14e6ca905000e39085dfa" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:22.210101 16572 leader_election.cc:343] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:22.210724 16572 leader_election.cc:343] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.211073 16572 leader_election.cc:304] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:22.212637 16722 ts_tablet_manager.cc:1434] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20260204 08:58:22.213505 16722 tablet_bootstrap.cc:492] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:22.215055 16735 raft_consensus.cc:2749] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:22.235464 16723 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.235970 16723 ts_tablet_manager.cc:1403] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.085s user 0.041s sys 0.008s
I20260204 08:58:22.238199 16725 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:22.238685 16725 ts_tablet_manager.cc:1403] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.145s user 0.023s sys 0.041s
I20260204 08:58:22.241187 16723 raft_consensus.cc:359] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.241864 16723 raft_consensus.cc:385] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.242136 16723 raft_consensus.cc:740] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.241655 16427 catalog_manager.cc:5654] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:22.242707 16723 consensus_queue.cc:260] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.245841 16725 raft_consensus.cc:359] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.246212 16722 tablet_bootstrap.cc:654] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.246491 16725 raft_consensus.cc:385] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.246776 16725 raft_consensus.cc:740] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.248409 16725 consensus_queue.cc:260] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.251961 16846 raft_consensus.cc:493] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.252380 16846 raft_consensus.cc:515] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.253139 16725 ts_tablet_manager.cc:1434] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.014s user 0.004s sys 0.001s
I20260204 08:58:22.253981 16725 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.254143 16846 leader_election.cc:290] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.254595 16794 consensus_queue.cc:1048] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.255478 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.258622 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.257229 16679 raft_consensus.cc:2468] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.259261 16603 raft_consensus.cc:2468] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.260622 16723 ts_tablet_manager.cc:1434] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260204 08:58:22.261468 16723 tablet_bootstrap.cc:492] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.264035 16497 leader_election.cc:304] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:22.265473 16849 raft_consensus.cc:2804] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.269644 16722 tablet_bootstrap.cc:492] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:22.270102 16722 ts_tablet_manager.cc:1403] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.057s user 0.007s sys 0.006s
I20260204 08:58:22.267524 16849 raft_consensus.cc:493] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.280701 16849 raft_consensus.cc:3060] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.280630 16794 consensus_queue.cc:1048] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.287187 16723 tablet_bootstrap.cc:654] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.288152 16722 raft_consensus.cc:359] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.289850 16722 raft_consensus.cc:385] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.290108 16722 raft_consensus.cc:740] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.290696 16722 consensus_queue.cc:260] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:22.293823 16497 consensus_peers.cc:597] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:22.296229 16725 tablet_bootstrap.cc:654] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.302542 16846 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.309541 16722 ts_tablet_manager.cc:1434] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260204 08:58:22.316900 16849 raft_consensus.cc:515] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.318852 16849 leader_election.cc:290] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.320264 16722 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:22.319574 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:22.319983 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:22.321463 16603 raft_consensus.cc:3060] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.321626 16680 raft_consensus.cc:3060] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.331838 16603 raft_consensus.cc:2468] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:22.333591 16844 raft_consensus.cc:493] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.333968 16844 raft_consensus.cc:515] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.334816 16680 raft_consensus.cc:2468] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:22.335798 16497 leader_election.cc:304] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:22.336166 16844 leader_election.cc:290] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:22.337977 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.338402 16796 raft_consensus.cc:2804] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.338580 16602 raft_consensus.cc:2468] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:22.338892 16796 raft_consensus.cc:697] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
W20260204 08:58:22.339998 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:58:22.339716 16796 consensus_queue.cc:237] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.336890 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.342085 16647 leader_election.cc:304] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:22.342821 16844 raft_consensus.cc:2804] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.343173 16844 raft_consensus.cc:493] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.343508 16844 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:58:22.343586 16646 leader_election.cc:343] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.345577 16723 tablet_bootstrap.cc:492] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.346011 16723 ts_tablet_manager.cc:1403] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.085s user 0.012s sys 0.004s
I20260204 08:58:22.352548 16844 raft_consensus.cc:515] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.364701 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
W20260204 08:58:22.367628 16646 leader_election.cc:343] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.368605 16849 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.375330 16723 raft_consensus.cc:359] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.376144 16722 tablet_bootstrap.cc:654] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.376310 16723 raft_consensus.cc:385] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.376885 16723 raft_consensus.cc:740] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.377692 16723 consensus_queue.cc:260] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.383931 16725 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:22.384311 16725 ts_tablet_manager.cc:1403] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.131s user 0.012s sys 0.000s
I20260204 08:58:22.385170 16844 leader_election.cc:290] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:22.386268 16723 ts_tablet_manager.cc:1434] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.040s user 0.006s sys 0.001s
I20260204 08:58:22.386452 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:22.387107 16603 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.387190 16723 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.390542 16725 raft_consensus.cc:359] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.391007 16725 raft_consensus.cc:385] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.391218 16725 raft_consensus.cc:740] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.404922 16725 consensus_queue.cc:260] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.401361 16427 catalog_manager.cc:5654] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:22.408318 16725 ts_tablet_manager.cc:1434] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.024s user 0.012s sys 0.007s
I20260204 08:58:22.410808 16725 tablet_bootstrap.cc:492] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.415583 16603 raft_consensus.cc:2468] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:22.416707 16647 leader_election.cc:304] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:22.417899 16844 raft_consensus.cc:2804] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.418545 16844 raft_consensus.cc:697] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:22.419687 16844 consensus_queue.cc:237] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.421257 16723 tablet_bootstrap.cc:654] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.425592 16725 tablet_bootstrap.cc:654] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.427495 16746 raft_consensus.cc:493] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.428009 16746 raft_consensus.cc:515] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.430847 16746 leader_election.cc:290] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:22.433185 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.433609 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.433804 16603 raft_consensus.cc:2468] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:22.435281 16647 leader_election.cc:304] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
W20260204 08:58:22.436070 16646 leader_election.cc:343] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.436995 16746 raft_consensus.cc:2804] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.437366 16746 raft_consensus.cc:493] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.437692 16746 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.441684 16722 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:22.442126 16722 ts_tablet_manager.cc:1403] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.122s user 0.011s sys 0.005s
I20260204 08:58:22.444558 16773 consensus_queue.cc:1048] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.445806 16722 raft_consensus.cc:359] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.446440 16722 raft_consensus.cc:385] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.446695 16722 raft_consensus.cc:740] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.447819 16723 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.448227 16723 ts_tablet_manager.cc:1403] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.061s user 0.013s sys 0.005s
I20260204 08:58:22.448319 16722 consensus_queue.cc:260] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.450742 16723 raft_consensus.cc:359] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.452476 16723 raft_consensus.cc:385] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.454464 16723 raft_consensus.cc:740] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.455360 16735 raft_consensus.cc:493] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.455834 16735 raft_consensus.cc:515] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.454980 16746 raft_consensus.cc:515] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.456017 16723 consensus_queue.cc:260] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.458402 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
W20260204 08:58:22.464066 16646 leader_election.cc:343] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.464772 16725 tablet_bootstrap.cc:492] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:22.469105 16725 ts_tablet_manager.cc:1403] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.006s
I20260204 08:58:22.468046 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:22.469869 16605 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.459224 16722 ts_tablet_manager.cc:1434] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.017s user 0.002s sys 0.006s
I20260204 08:58:22.459721 16735 leader_election.cc:290] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.459738 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.471549 16725 raft_consensus.cc:359] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.459956 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.477030 16526 raft_consensus.cc:2468] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:22.462061 16779 raft_consensus.cc:493] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.477013 16725 raft_consensus.cc:385] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.478863 16725 raft_consensus.cc:740] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
W20260204 08:58:22.479574 16572 leader_election.cc:343] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.479524 16725 consensus_queue.cc:260] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.480310 16572 leader_election.cc:304] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:22.484023 16910 consensus_queue.cc:1048] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.478510 16779 raft_consensus.cc:515] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.466717 16746 leader_election.cc:290] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:22.484934 16735 raft_consensus.cc:2804] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.485292 16735 raft_consensus.cc:493] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.485596 16735 raft_consensus.cc:3060] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.485838 16779 leader_election.cc:290] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.486066 16605 raft_consensus.cc:2468] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:22.488443 16647 leader_election.cc:304] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:22.489852 16725 ts_tablet_manager.cc:1434] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260204 08:58:22.490226 16734 raft_consensus.cc:2804] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.490682 16734 raft_consensus.cc:697] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:22.490835 16725 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.492064 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be0afba4e5c14c95870971bc8c2c7225" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.492305 16734 consensus_queue.cc:237] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.488163 16723 ts_tablet_manager.cc:1434] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.040s user 0.006s sys 0.002s
I20260204 08:58:22.474581 16426 catalog_manager.cc:5654] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:22.495249 16723 tablet_bootstrap.cc:492] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.495893 16722 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:22.493803 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be0afba4e5c14c95870971bc8c2c7225" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.498333 16679 raft_consensus.cc:2393] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f959652a42f34a81aca5da9faec0a7a3 in current term 1: Already voted for candidate 35380a227e2c4fa4a063d4fd67c30b53 in this term.
I20260204 08:58:22.499487 16572 leader_election.cc:304] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:22.501276 16909 raft_consensus.cc:3060] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.508810 16735 raft_consensus.cc:515] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.516021 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:22.516572 16530 raft_consensus.cc:3060] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.517079 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
W20260204 08:58:22.518275 16572 leader_election.cc:343] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.519083 16735 leader_election.cc:290] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.521154 16909 raft_consensus.cc:2749] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:22.522977 16530 raft_consensus.cc:2468] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:22.537417 16725 tablet_bootstrap.cc:654] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.539304 16796 raft_consensus.cc:493] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.542798 16794 raft_consensus.cc:493] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.544381 16723 tablet_bootstrap.cc:654] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.540230 16796 raft_consensus.cc:515] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.543694 16572 leader_election.cc:304] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:22.545619 16909 raft_consensus.cc:2804] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.545327 16794 raft_consensus.cc:515] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.546041 16909 raft_consensus.cc:697] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:22.546689 16909 consensus_queue.cc:237] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.547231 16794 leader_election.cc:290] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.546586 16426 catalog_manager.cc:5654] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:22.548007 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.548936 16722 tablet_bootstrap.cc:654] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.549129 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:22.549655 16498 leader_election.cc:343] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:22.550887 16497 leader_election.cc:343] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.551494 16497 leader_election.cc:304] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:22.553354 16796 leader_election.cc:290] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.553869 16796 raft_consensus.cc:2749] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:22.556320 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa4d147d1fb14e6ca905000e39085dfa" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.558552 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa4d147d1fb14e6ca905000e39085dfa" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.559120 16679 raft_consensus.cc:2468] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.561111 16497 leader_election.cc:304] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:22.556942 16605 raft_consensus.cc:2468] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.562382 16794 raft_consensus.cc:2804] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.564525 16794 raft_consensus.cc:493] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.565420 16794 raft_consensus.cc:3060] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.567600 16725 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:22.568264 16725 ts_tablet_manager.cc:1403] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.078s user 0.012s sys 0.007s
I20260204 08:58:22.570915 16723 tablet_bootstrap.cc:492] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.571270 16723 ts_tablet_manager.cc:1403] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.076s user 0.011s sys 0.000s
W20260204 08:58:22.577086 16498 consensus_peers.cc:597] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:22.579916 16725 raft_consensus.cc:359] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.580092 16794 raft_consensus.cc:515] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.579749 16427 catalog_manager.cc:5654] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:22.580556 16725 raft_consensus.cc:385] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.580842 16725 raft_consensus.cc:740] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.581398 16725 consensus_queue.cc:260] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.582598 16723 raft_consensus.cc:359] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.583200 16723 raft_consensus.cc:385] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.583441 16723 raft_consensus.cc:740] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.583988 16725 ts_tablet_manager.cc:1434] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260204 08:58:22.584722 16723 consensus_queue.cc:260] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.585175 16725 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.586726 16723 ts_tablet_manager.cc:1434] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260204 08:58:22.587474 16723 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.590932 16725 tablet_bootstrap.cc:654] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.591910 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa4d147d1fb14e6ca905000e39085dfa" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:22.604027 16679 raft_consensus.cc:3060] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.604053 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa4d147d1fb14e6ca905000e39085dfa" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:22.604745 16602 raft_consensus.cc:3060] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.593844 16723 tablet_bootstrap.cc:654] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.600246 16722 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:22.609696 16722 ts_tablet_manager.cc:1403] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.114s user 0.007s sys 0.015s
I20260204 08:58:22.602692 16725 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:22.581934 16794 leader_election.cc:290] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.610426 16725 ts_tablet_manager.cc:1403] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.003s
I20260204 08:58:22.611467 16849 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.612262 16722 raft_consensus.cc:359] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.612879 16722 raft_consensus.cc:385] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.613137 16722 raft_consensus.cc:740] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.613865 16722 consensus_queue.cc:260] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.614264 16679 raft_consensus.cc:2468] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:22.616024 16722 ts_tablet_manager.cc:1434] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260204 08:58:22.617343 16722 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:22.617226 16497 leader_election.cc:304] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:22.618152 16794 raft_consensus.cc:2804] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.618566 16794 raft_consensus.cc:697] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:22.618961 16602 raft_consensus.cc:2468] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:22.619339 16794 consensus_queue.cc:237] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.624218 16722 tablet_bootstrap.cc:654] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.624332 16725 raft_consensus.cc:359] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.625622 16725 raft_consensus.cc:385] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.625895 16725 raft_consensus.cc:740] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.626489 16725 consensus_queue.cc:260] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.628895 16725 ts_tablet_manager.cc:1434] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.018s user 0.004s sys 0.002s
I20260204 08:58:22.630014 16725 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.641657 16725 tablet_bootstrap.cc:654] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.645545 16849 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.645408 16426 catalog_manager.cc:5654] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:22.653970 16723 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.654410 16723 ts_tablet_manager.cc:1403] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.067s user 0.014s sys 0.005s
I20260204 08:58:22.656666 16723 raft_consensus.cc:359] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.657289 16723 raft_consensus.cc:385] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.657553 16723 raft_consensus.cc:740] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.658073 16723 consensus_queue.cc:260] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.660882 16722 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:22.661262 16722 ts_tablet_manager.cc:1403] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.009s
I20260204 08:58:22.663609 16722 raft_consensus.cc:359] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.664224 16722 raft_consensus.cc:385] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.664471 16722 raft_consensus.cc:740] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.665000 16722 consensus_queue.cc:260] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.667215 16725 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:22.667676 16725 ts_tablet_manager.cc:1403] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.000s
I20260204 08:58:22.668484 16723 ts_tablet_manager.cc:1434] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260204 08:58:22.668399 16909 raft_consensus.cc:493] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.668943 16909 raft_consensus.cc:515] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.669399 16723 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.671947 16725 raft_consensus.cc:359] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.672560 16725 raft_consensus.cc:385] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.672817 16725 raft_consensus.cc:740] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.673465 16725 consensus_queue.cc:260] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.673789 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.672834 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:22.675009 16572 leader_election.cc:343] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.675078 16530 raft_consensus.cc:2468] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:22.675815 16725 ts_tablet_manager.cc:1434] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260204 08:58:22.676576 16572 leader_election.cc:304] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:22.676828 16725 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.677358 16779 raft_consensus.cc:2804] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.677708 16779 raft_consensus.cc:493] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.678026 16779 raft_consensus.cc:3060] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.678184 16722 ts_tablet_manager.cc:1434] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.017s user 0.005s sys 0.001s
I20260204 08:58:22.679088 16722 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:22.676858 16723 tablet_bootstrap.cc:654] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.680718 16909 leader_election.cc:290] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.685076 16725 tablet_bootstrap.cc:654] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.687440 16722 tablet_bootstrap.cc:654] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.691147 16779 raft_consensus.cc:515] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.702850 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:22.703192 16723 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.703388 16530 raft_consensus.cc:3060] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.703610 16723 ts_tablet_manager.cc:1403] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.034s user 0.012s sys 0.001s
I20260204 08:58:22.706017 16723 raft_consensus.cc:359] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.706667 16723 raft_consensus.cc:385] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.706929 16723 raft_consensus.cc:740] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.707523 16723 consensus_queue.cc:260] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.709581 16723 ts_tablet_manager.cc:1434] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20260204 08:58:22.710407 16723 tablet_bootstrap.cc:492] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.710512 16530 raft_consensus.cc:2468] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:22.712880 16722 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:22.713364 16722 ts_tablet_manager.cc:1403] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.034s user 0.018s sys 0.000s
I20260204 08:58:22.713536 16572 leader_election.cc:304] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:22.714542 16909 raft_consensus.cc:2804] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.715543 16909 raft_consensus.cc:697] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:22.716150 16722 raft_consensus.cc:359] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.716840 16722 raft_consensus.cc:385] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.716410 16909 consensus_queue.cc:237] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.716922 16723 tablet_bootstrap.cc:654] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.717185 16722 raft_consensus.cc:740] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.717919 16722 consensus_queue.cc:260] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.725266 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
W20260204 08:58:22.726684 16572 leader_election.cc:343] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.727443 16779 leader_election.cc:290] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.728341 16722 ts_tablet_manager.cc:1434] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.015s user 0.004s sys 0.001s
I20260204 08:58:22.732692 16678 raft_consensus.cc:3060] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.742779 16722 tablet_bootstrap.cc:492] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:22.747762 16849 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.754482 16723 tablet_bootstrap.cc:492] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:22.754973 16723 ts_tablet_manager.cc:1403] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.045s user 0.012s sys 0.001s
I20260204 08:58:22.762809 16849 consensus_queue.cc:1048] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.763960 16430 catalog_manager.cc:5654] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:22.785727 16849 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.788897 16849 raft_consensus.cc:493] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.789338 16849 raft_consensus.cc:515] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.792871 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.793593 16605 raft_consensus.cc:2393] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35380a227e2c4fa4a063d4fd67c30b53 in current term 1: Already voted for candidate 86e16045049f4f87a94336b5d2262328 in this term.
I20260204 08:58:22.793908 16849 leader_election.cc:290] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.793884 16909 raft_consensus.cc:493] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.795128 16909 raft_consensus.cc:515] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.794538 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.797689 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51b94b814b049a19e2c94de66731467" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.798903 16497 leader_election.cc:304] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
W20260204 08:58:22.799052 16572 leader_election.cc:343] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.800868 16849 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.806808 16796 raft_consensus.cc:493] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.807309 16796 raft_consensus.cc:515] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.809242 16796 leader_election.cc:290] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.810741 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8f14fd5174a4d98b1849c67325173" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.811353 16605 raft_consensus.cc:2468] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.812785 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8f14fd5174a4d98b1849c67325173" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.813400 16681 raft_consensus.cc:2468] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.814416 16909 leader_election.cc:290] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.815716 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51b94b814b049a19e2c94de66731467" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:22.817589 16572 leader_election.cc:343] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:22.818027 16572 leader_election.cc:304] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:22.814620 16498 leader_election.cc:304] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:22.819641 16909 raft_consensus.cc:2749] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:22.821710 16796 raft_consensus.cc:2804] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.822106 16796 raft_consensus.cc:493] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.822423 16796 raft_consensus.cc:3060] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.829173 16723 raft_consensus.cc:359] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.829947 16723 raft_consensus.cc:385] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.830174 16723 raft_consensus.cc:740] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.830762 16723 consensus_queue.cc:260] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.832384 16796 raft_consensus.cc:515] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.833839 16723 ts_tablet_manager.cc:1434] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.079s user 0.013s sys 0.018s
I20260204 08:58:22.835130 16723 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:22.841575 16910 raft_consensus.cc:493] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.842082 16910 raft_consensus.cc:515] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.844110 16796 leader_election.cc:290] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.844594 16910 leader_election.cc:290] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:22.845242 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8f14fd5174a4d98b1849c67325173" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:22.846575 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.858542 16722 tablet_bootstrap.cc:654] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.851457 16849 raft_consensus.cc:2749] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:22.862167 16605 raft_consensus.cc:3060] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.862046 16526 raft_consensus.cc:2393] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86e16045049f4f87a94336b5d2262328 in current term 1: Already voted for candidate f959652a42f34a81aca5da9faec0a7a3 in this term.
I20260204 08:58:22.863354 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8f14fd5174a4d98b1849c67325173" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:22.864571 16680 raft_consensus.cc:3060] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.867136 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.873610 16647 leader_election.cc:304] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:22.875381 16734 raft_consensus.cc:3060] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.877245 16844 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.880970 16680 raft_consensus.cc:2468] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:22.888927 16605 raft_consensus.cc:2468] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:22.899492 16497 leader_election.cc:304] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:22.908620 16794 raft_consensus.cc:2804] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:22.909152 16734 raft_consensus.cc:2749] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:22.915468 16794 raft_consensus.cc:697] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:22.916354 16794 consensus_queue.cc:237] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.917403 16734 raft_consensus.cc:493] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.927524 16725 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:22.928027 16725 ts_tablet_manager.cc:1403] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.251s user 0.055s sys 0.094s
I20260204 08:58:22.930382 16725 raft_consensus.cc:359] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.931020 16725 raft_consensus.cc:385] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:22.931277 16725 raft_consensus.cc:740] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:22.931891 16725 consensus_queue.cc:260] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.923448 16734 raft_consensus.cc:515] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.935875 16725 ts_tablet_manager.cc:1434] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260204 08:58:22.936916 16725 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:22.941641 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d633fea539421b8df68b6b69649892" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:22.942272 16526 raft_consensus.cc:2468] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:22.945628 16746 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:22.949081 16646 leader_election.cc:304] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:22.952183 16844 raft_consensus.cc:2804] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.952734 16844 raft_consensus.cc:493] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.953060 16844 raft_consensus.cc:3060] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.955308 16734 leader_election.cc:290] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:22.958455 16427 catalog_manager.cc:5654] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:22.959383 16794 raft_consensus.cc:493] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.959856 16794 raft_consensus.cc:515] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.962909 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "326778f65c8845f5bc8e4a236d093bfe" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:22.963286 16725 tablet_bootstrap.cc:654] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:22.963622 16680 raft_consensus.cc:2468] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:22.964767 16497 leader_election.cc:304] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:22.965984 16723 tablet_bootstrap.cc:654] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
W20260204 08:58:22.963733 16646 consensus_peers.cc:597] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:22.975215 16909 raft_consensus.cc:493] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:22.976009 16909 raft_consensus.cc:515] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:22.978647 16909 leader_election.cc:290] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.979532 16934 raft_consensus.cc:2804] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:22.982064 16934 raft_consensus.cc:493] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:22.982388 16934 raft_consensus.cc:3060] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:22.986135 16794 leader_election.cc:290] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:22.997874 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d633fea539421b8df68b6b69649892" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:22.981518 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.002624 16722 tablet_bootstrap.cc:492] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:23.003104 16722 ts_tablet_manager.cc:1403] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.261s user 0.020s sys 0.016s
I20260204 08:58:23.004408 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:23.006896 16572 leader_election.cc:304] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:23.008005 16909 raft_consensus.cc:2749] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.009460 16844 raft_consensus.cc:515] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:23.010565 16647 leader_election.cc:343] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.014513 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d633fea539421b8df68b6b69649892" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:23.015132 16530 raft_consensus.cc:3060] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.023927 16530 raft_consensus.cc:2468] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:23.012271 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "326778f65c8845f5bc8e4a236d093bfe" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.025029 16603 raft_consensus.cc:2468] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:23.025404 16646 leader_election.cc:304] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:23.026108 16844 leader_election.cc:290] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.026649 16844 raft_consensus.cc:2804] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:23.027081 16844 raft_consensus.cc:697] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:23.039499 16794 consensus_queue.cc:1048] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.043669 16934 raft_consensus.cc:515] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.045475 16722 raft_consensus.cc:359] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.046244 16722 raft_consensus.cc:385] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.046598 16725 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.047133 16725 ts_tablet_manager.cc:1403] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.110s user 0.026s sys 0.017s
I20260204 08:58:23.046597 16722 raft_consensus.cc:740] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.027866 16844 consensus_queue.cc:237] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.048092 16722 consensus_queue.cc:260] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.050361 16722 ts_tablet_manager.cc:1434] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.047s user 0.009s sys 0.000s
I20260204 08:58:23.051352 16722 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:23.056391 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "326778f65c8845f5bc8e4a236d093bfe" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:23.056991 16602 raft_consensus.cc:3060] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.046916 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d633fea539421b8df68b6b69649892" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:23.064124 16602 raft_consensus.cc:2468] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
W20260204 08:58:23.065303 16647 leader_election.cc:343] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.066870 16498 leader_election.cc:304] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:23.067596 16794 raft_consensus.cc:2804] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:23.068078 16794 raft_consensus.cc:697] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:23.068943 16794 consensus_queue.cc:237] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.072748 16722 tablet_bootstrap.cc:654] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.077328 16934 leader_election.cc:290] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.078578 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "326778f65c8845f5bc8e4a236d093bfe" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:23.079144 16678 raft_consensus.cc:3060] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.079056 16725 raft_consensus.cc:359] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.079756 16725 raft_consensus.cc:385] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.080011 16725 raft_consensus.cc:740] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.080137 16430 catalog_manager.cc:5654] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:23.080632 16725 consensus_queue.cc:260] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.082849 16725 ts_tablet_manager.cc:1434] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.036s user 0.005s sys 0.000s
I20260204 08:58:23.084604 16725 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:23.085939 16846 consensus_queue.cc:1048] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.089435 16722 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:23.089946 16725 tablet_bootstrap.cc:654] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.089895 16722 ts_tablet_manager.cc:1403] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.039s user 0.009s sys 0.006s
I20260204 08:58:23.093971 16723 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:23.094297 16678 raft_consensus.cc:2468] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:23.094416 16723 ts_tablet_manager.cc:1403] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.260s user 0.011s sys 0.018s
I20260204 08:58:23.096808 16723 raft_consensus.cc:359] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.097455 16723 raft_consensus.cc:385] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.097728 16723 raft_consensus.cc:740] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.098376 16723 consensus_queue.cc:260] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.100904 16723 ts_tablet_manager.cc:1434] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260204 08:58:23.101378 16844 consensus_queue.cc:1048] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.102224 16723 tablet_bootstrap.cc:492] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:23.108014 16909 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.112965 16722 raft_consensus.cc:359] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.113603 16722 raft_consensus.cc:385] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.113891 16722 raft_consensus.cc:740] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.114538 16722 consensus_queue.cc:260] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.116508 16722 ts_tablet_manager.cc:1434] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.026s user 0.001s sys 0.004s
I20260204 08:58:23.117404 16722 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:23.118366 16429 catalog_manager.cc:5654] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
W20260204 08:58:23.124414 16572 consensus_peers.cc:597] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:23.125526 16779 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.126518 16909 raft_consensus.cc:493] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.126946 16909 raft_consensus.cc:515] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.128547 16909 leader_election.cc:290] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.131479 16722 tablet_bootstrap.cc:654] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.140367 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:23.141719 16572 leader_election.cc:343] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.142865 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:23.146065 16572 leader_election.cc:343] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.146504 16572 leader_election.cc:304] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:23.146819 16723 tablet_bootstrap.cc:654] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.147850 16909 raft_consensus.cc:2749] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.154619 16725 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.155141 16725 ts_tablet_manager.cc:1403] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.071s user 0.009s sys 0.008s
I20260204 08:58:23.160451 16723 tablet_bootstrap.cc:492] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:23.160970 16723 ts_tablet_manager.cc:1403] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.059s user 0.011s sys 0.000s
I20260204 08:58:23.167282 16725 raft_consensus.cc:359] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.168246 16725 raft_consensus.cc:385] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.168498 16725 raft_consensus.cc:740] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.169087 16725 consensus_queue.cc:260] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.172709 16725 ts_tablet_manager.cc:1434] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.017s user 0.001s sys 0.005s
I20260204 08:58:23.173687 16725 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:23.180188 16947 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.182265 16602 raft_consensus.cc:3060] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.185158 16725 tablet_bootstrap.cc:654] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.189188 16723 raft_consensus.cc:359] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.189862 16723 raft_consensus.cc:385] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.190308 16723 raft_consensus.cc:740] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.190979 16723 consensus_queue.cc:260] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.192292 16746 raft_consensus.cc:493] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.192727 16746 raft_consensus.cc:515] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.193511 16723 ts_tablet_manager.cc:1434] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260204 08:58:23.194356 16723 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:23.194517 16746 leader_election.cc:290] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.196281 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8c1585bad41eb94f02214a751600b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:23.197659 16646 leader_election.cc:343] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.199158 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8c1585bad41eb94f02214a751600b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.199750 16603 raft_consensus.cc:2468] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:23.200076 16723 tablet_bootstrap.cc:654] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.200955 16647 leader_election.cc:304] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:23.202666 16746 raft_consensus.cc:2804] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:23.203089 16746 raft_consensus.cc:493] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:23.203491 16746 raft_consensus.cc:3060] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.210383 16746 raft_consensus.cc:515] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.212118 16723 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:23.211895 16722 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:23.212534 16723 ts_tablet_manager.cc:1403] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260204 08:58:23.212611 16722 ts_tablet_manager.cc:1403] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.095s user 0.025s sys 0.017s
I20260204 08:58:23.215140 16723 raft_consensus.cc:359] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.215780 16723 raft_consensus.cc:385] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.216018 16723 raft_consensus.cc:740] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.216321 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8c1585bad41eb94f02214a751600b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:23.216711 16723 consensus_queue.cc:260] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:23.217819 16646 leader_election.cc:343] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.218974 16723 ts_tablet_manager.cc:1434] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260204 08:58:23.219911 16723 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:23.219012 16722 raft_consensus.cc:359] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.225266 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8c1585bad41eb94f02214a751600b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:23.227139 16603 raft_consensus.cc:3060] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.226636 16746 leader_election.cc:290] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.227274 16722 raft_consensus.cc:385] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.227986 16722 raft_consensus.cc:740] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.228874 16734 raft_consensus.cc:493] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.229308 16734 raft_consensus.cc:515] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.231076 16734 leader_election.cc:290] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.233572 16603 raft_consensus.cc:2468] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:23.227104 16723 tablet_bootstrap.cc:654] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.233721 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.233834 16722 consensus_queue.cc:260] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:23.235330 16647 leader_election.cc:343] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.233749 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:23.236723 16646 leader_election.cc:343] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.237131 16647 leader_election.cc:304] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:23.237828 16722 ts_tablet_manager.cc:1434] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20260204 08:58:23.237131 16646 leader_election.cc:304] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:23.239192 16734 raft_consensus.cc:2749] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.238209 16746 raft_consensus.cc:2804] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:23.240833 16746 raft_consensus.cc:697] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:23.241773 16746 consensus_queue.cc:237] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.246649 16722 tablet_bootstrap.cc:492] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:23.261189 16722 tablet_bootstrap.cc:654] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.264153 16725 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.264597 16725 ts_tablet_manager.cc:1403] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.091s user 0.027s sys 0.028s
I20260204 08:58:23.267241 16725 raft_consensus.cc:359] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.267889 16725 raft_consensus.cc:385] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.268136 16725 raft_consensus.cc:740] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.268775 16725 consensus_queue.cc:260] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.270895 16723 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:23.270961 16725 ts_tablet_manager.cc:1434] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260204 08:58:23.271454 16723 ts_tablet_manager.cc:1403] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.052s user 0.013s sys 0.003s
I20260204 08:58:23.271919 16725 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:23.273990 16723 raft_consensus.cc:359] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.274600 16723 raft_consensus.cc:385] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.274868 16723 raft_consensus.cc:740] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.275291 16430 catalog_manager.cc:5654] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:23.275837 16723 consensus_queue.cc:260] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.278414 16725 tablet_bootstrap.cc:654] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.281277 16723 ts_tablet_manager.cc:1434] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.010s user 0.004s sys 0.001s
I20260204 08:58:23.282507 16723 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:23.287616 16722 tablet_bootstrap.cc:492] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:23.288136 16722 ts_tablet_manager.cc:1403] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.042s user 0.014s sys 0.004s
I20260204 08:58:23.288767 16723 tablet_bootstrap.cc:654] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.292654 16725 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.293957 16725 ts_tablet_manager.cc:1403] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.005s
I20260204 08:58:23.294456 16722 raft_consensus.cc:359] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.297744 16722 raft_consensus.cc:385] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.298099 16722 raft_consensus.cc:740] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.298884 16722 consensus_queue.cc:260] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.304987 16722 ts_tablet_manager.cc:1434] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.017s user 0.005s sys 0.004s
I20260204 08:58:23.307327 16722 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:23.296337 16725 raft_consensus.cc:359] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.312289 16725 raft_consensus.cc:385] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.312572 16725 raft_consensus.cc:740] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.313169 16725 consensus_queue.cc:260] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.315114 16725 ts_tablet_manager.cc:1434] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260204 08:58:23.316030 16725 tablet_bootstrap.cc:492] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:23.321394 16746 raft_consensus.cc:493] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.322324 16725 tablet_bootstrap.cc:654] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.322060 16746 raft_consensus.cc:515] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.324442 16746 leader_election.cc:290] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.326507 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457a55a8c34648f6ae2a009fcb9fd749" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.327131 16603 raft_consensus.cc:2468] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:23.328855 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457a55a8c34648f6ae2a009fcb9fd749" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:23.329530 16647 leader_election.cc:304] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:23.332643 16734 raft_consensus.cc:2804] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:23.332978 16734 raft_consensus.cc:493] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:23.333278 16734 raft_consensus.cc:3060] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.332355 16723 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
W20260204 08:58:23.334663 16646 leader_election.cc:343] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.336779 16722 tablet_bootstrap.cc:654] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.333961 16723 ts_tablet_manager.cc:1403] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.052s user 0.015s sys 0.024s
I20260204 08:58:23.342866 16734 raft_consensus.cc:515] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.345126 16734 leader_election.cc:290] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.346572 16725 tablet_bootstrap.cc:492] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.347025 16725 ts_tablet_manager.cc:1403] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.018s
I20260204 08:58:23.348352 16846 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.349107 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457a55a8c34648f6ae2a009fcb9fd749" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:23.349660 16602 raft_consensus.cc:3060] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.352255 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457a55a8c34648f6ae2a009fcb9fd749" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
W20260204 08:58:23.353688 16646 leader_election.cc:343] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.355588 16602 raft_consensus.cc:2468] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:23.355566 16723 raft_consensus.cc:359] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.356361 16723 raft_consensus.cc:385] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.356647 16647 leader_election.cc:304] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:23.358275 16746 raft_consensus.cc:2804] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:23.358601 16725 raft_consensus.cc:359] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.358714 16746 raft_consensus.cc:697] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:23.359243 16725 raft_consensus.cc:385] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.360030 16746 consensus_queue.cc:237] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.359550 16725 raft_consensus.cc:740] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.361096 16725 consensus_queue.cc:260] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.363150 16725 ts_tablet_manager.cc:1434] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260204 08:58:23.364059 16725 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:23.356642 16723 raft_consensus.cc:740] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.368356 16723 consensus_queue.cc:260] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.373840 16722 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:23.374301 16722 ts_tablet_manager.cc:1403] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.067s user 0.009s sys 0.000s
I20260204 08:58:23.370777 16723 ts_tablet_manager.cc:1434] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.033s user 0.005s sys 0.001s
I20260204 08:58:23.377266 16723 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
W20260204 08:58:23.379084 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:58:23.380421 16430 catalog_manager.cc:5654] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:23.381374 16725 tablet_bootstrap.cc:654] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.384089 16723 tablet_bootstrap.cc:654] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.379052 16722 raft_consensus.cc:359] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.387387 16734 raft_consensus.cc:493] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.387717 16722 raft_consensus.cc:385] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.388046 16722 raft_consensus.cc:740] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.387951 16734 raft_consensus.cc:515] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.388726 16722 consensus_queue.cc:260] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.390815 16722 ts_tablet_manager.cc:1434] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260204 08:58:23.391620 16722 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:23.393249 16934 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.393810 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:23.397151 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.398833 16602 raft_consensus.cc:2468] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:23.400225 16647 leader_election.cc:304] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
W20260204 08:58:23.401968 16646 leader_election.cc:343] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.398186 16734 leader_election.cc:290] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.404347 16796 raft_consensus.cc:493] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.404868 16796 raft_consensus.cc:515] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.408712 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.418044 16746 raft_consensus.cc:2804] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:23.421271 16746 raft_consensus.cc:493] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:23.421725 16746 raft_consensus.cc:3060] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.422338 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.410141 16796 leader_election.cc:290] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.434494 16909 raft_consensus.cc:493] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.442263 16722 tablet_bootstrap.cc:654] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.440068 16909 raft_consensus.cc:515] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.440335 16498 leader_election.cc:304] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:23.444975 16934 raft_consensus.cc:2749] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.445415 16909 leader_election.cc:290] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.448253 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d633fea539421b8df68b6b69649892" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:23.448457 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d633fea539421b8df68b6b69649892" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.449012 16530 raft_consensus.cc:2393] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f959652a42f34a81aca5da9faec0a7a3 in current term 1: Already voted for candidate 86e16045049f4f87a94336b5d2262328 in this term.
I20260204 08:58:23.449879 16746 raft_consensus.cc:515] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.455471 16909 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.455973 16909 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.470649 16725 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.471156 16725 ts_tablet_manager.cc:1403] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.107s user 0.016s sys 0.052s
I20260204 08:58:23.471256 16909 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.470533 16746 leader_election.cc:290] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.472806 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:23.473436 16602 raft_consensus.cc:3060] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.473565 16725 raft_consensus.cc:359] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.474267 16725 raft_consensus.cc:385] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.474519 16725 raft_consensus.cc:740] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.475138 16725 consensus_queue.cc:260] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.477167 16725 ts_tablet_manager.cc:1434] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20260204 08:58:23.477164 16572 leader_election.cc:304] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:23.478113 16909 raft_consensus.cc:3060] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.478210 16725 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:23.482348 16602 raft_consensus.cc:2468] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:23.486598 16725 tablet_bootstrap.cc:654] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.482581 16526 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.491621 16647 leader_election.cc:304] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:23.494362 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:23.495538 16734 raft_consensus.cc:2804] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:23.495710 16901 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.491803 16849 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.492367 16723 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:23.498052 16723 ts_tablet_manager.cc:1403] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.121s user 0.025s sys 0.028s
I20260204 08:58:23.497903 16849 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.500586 16849 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.501014 16723 raft_consensus.cc:359] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:23.501883 16646 leader_election.cc:343] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.501888 16723 raft_consensus.cc:385] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.502919 16723 raft_consensus.cc:740] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.502295 16734 raft_consensus.cc:697] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:23.503741 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.503890 16734 consensus_queue.cc:237] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.504585 16723 consensus_queue.cc:260] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:23.505092 16497 leader_election.cc:343] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.506938 16723 ts_tablet_manager.cc:1434] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260204 08:58:23.506367 16909 raft_consensus.cc:2749] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.508035 16723 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:23.490115 16796 raft_consensus.cc:493] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.526104 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.529940 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:23.530558 16529 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:23.531217 16723 tablet_bootstrap.cc:654] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.532362 16722 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:23.532789 16722 ts_tablet_manager.cc:1403] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.141s user 0.030s sys 0.020s
I20260204 08:58:23.518736 16796 raft_consensus.cc:515] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.540760 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.541381 16602 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:23.545758 16796 leader_election.cc:290] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.546815 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51b94b814b049a19e2c94de66731467" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.547410 16680 raft_consensus.cc:2468] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:23.547912 16725 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.548635 16497 leader_election.cc:304] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:23.549427 16725 ts_tablet_manager.cc:1403] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.071s user 0.008s sys 0.015s
I20260204 08:58:23.551880 16796 raft_consensus.cc:2804] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:23.552242 16796 raft_consensus.cc:493] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:23.552798 16796 raft_consensus.cc:3060] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.555914 16498 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:23.556807 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51b94b814b049a19e2c94de66731467" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.557421 16605 raft_consensus.cc:2468] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:23.557571 16794 raft_consensus.cc:2804] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:23.557984 16794 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:23.558287 16794 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.543795 16572 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
W20260204 08:58:23.562494 16572 leader_election.cc:343] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.565256 16725 raft_consensus.cc:359] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.566017 16725 raft_consensus.cc:385] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.566288 16725 raft_consensus.cc:740] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.568455 16909 raft_consensus.cc:2804] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:23.568861 16909 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:23.569188 16909 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.566882 16725 consensus_queue.cc:260] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.571938 16794 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.573683 16734 raft_consensus.cc:493] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.574144 16734 raft_consensus.cc:515] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.575624 16909 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.576509 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc74f40262504431847cf4419a26b480" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:23.579681 16529 raft_consensus.cc:2468] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:23.580535 16646 leader_election.cc:304] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:23.581013 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc74f40262504431847cf4419a26b480" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.577347 16734 leader_election.cc:290] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.578568 16725 ts_tablet_manager.cc:1434] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.029s user 0.003s sys 0.005s
I20260204 08:58:23.582691 16725 tablet_bootstrap.cc:492] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:23.582806 16722 raft_consensus.cc:359] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.583611 16722 raft_consensus.cc:385] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.583993 16722 raft_consensus.cc:740] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.578790 16796 raft_consensus.cc:515] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.584841 16722 consensus_queue.cc:260] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.590639 16427 catalog_manager.cc:5654] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:23.576575 16794 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.584802 16910 raft_consensus.cc:2804] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:23.600402 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:23.601172 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:23.601912 16603 raft_consensus.cc:2393] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35380a227e2c4fa4a063d4fd67c30b53 in current term 1: Already voted for candidate f959652a42f34a81aca5da9faec0a7a3 in this term.
I20260204 08:58:23.596772 16910 raft_consensus.cc:493] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:23.603996 16910 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:58:23.605825 16572 leader_election.cc:343] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.593595 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
W20260204 08:58:23.594062 16647 leader_election.cc:343] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:23.613673 16497 leader_election.cc:343] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.613849 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:23.619932 16722 ts_tablet_manager.cc:1434] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.087s user 0.006s sys 0.001s
I20260204 08:58:23.620992 16722 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:23.626463 16796 leader_election.cc:290] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.633571 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51b94b814b049a19e2c94de66731467" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:23.604981 16909 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.634143 16679 raft_consensus.cc:3060] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.638381 16532 raft_consensus.cc:2393] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f959652a42f34a81aca5da9faec0a7a3 in current term 1: Already voted for candidate 35380a227e2c4fa4a063d4fd67c30b53 in this term.
I20260204 08:58:23.643142 16846 raft_consensus.cc:493] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.644310 16846 raft_consensus.cc:515] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.645805 16844 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.646199 16846 leader_election.cc:290] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.641567 16498 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:23.649816 16901 raft_consensus.cc:2749] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.650144 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d51b94b814b049a19e2c94de66731467" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:23.650678 16602 raft_consensus.cc:3060] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.640678 16796 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260204 08:58:23.656015 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
W20260204 08:58:23.659986 16498 leader_election.cc:343] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.659621 16679 raft_consensus.cc:2468] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:23.660660 16602 raft_consensus.cc:2468] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:23.670559 16572 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:23.671602 16723 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:23.672091 16723 ts_tablet_manager.cc:1403] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.164s user 0.021s sys 0.013s
I20260204 08:58:23.660858 16910 raft_consensus.cc:515] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.675945 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.677265 16723 raft_consensus.cc:359] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.677914 16723 raft_consensus.cc:385] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.678174 16723 raft_consensus.cc:740] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.679344 16723 consensus_queue.cc:260] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.685132 16725 tablet_bootstrap.cc:654] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.674563 16975 raft_consensus.cc:2749] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.693236 16723 ts_tablet_manager.cc:1434] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260204 08:58:23.694456 16910 leader_election.cc:290] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.696329 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc74f40262504431847cf4419a26b480" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:23.696961 16526 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.702126 16910 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.709014 16498 leader_election.cc:304] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
W20260204 08:58:23.712364 16497 leader_election.cc:343] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.712831 16497 leader_election.cc:304] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:23.713580 16849 raft_consensus.cc:2804] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:23.714190 16796 raft_consensus.cc:2749] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.715307 16849 raft_consensus.cc:697] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:23.727995 16849 consensus_queue.cc:237] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.731940 16723 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:23.738963 16526 raft_consensus.cc:2468] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:23.749032 16646 leader_election.cc:304] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:23.754634 16773 raft_consensus.cc:2804] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:23.755120 16773 raft_consensus.cc:697] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:23.759912 16725 tablet_bootstrap.cc:492] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.759690 16773 consensus_queue.cc:237] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:23.756693 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:39491, user_credentials={real_user=slave}} blocked reactor thread for 44378.9us
I20260204 08:58:23.771526 16725 ts_tablet_manager.cc:1403] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.189s user 0.008s sys 0.011s
I20260204 08:58:23.768626 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc74f40262504431847cf4419a26b480" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:23.781580 16607 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.783797 16746 consensus_queue.cc:1048] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:23.785072 16722 tablet_bootstrap.cc:654] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.785248 16725 raft_consensus.cc:359] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.787256 16725 raft_consensus.cc:385] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.787578 16725 raft_consensus.cc:740] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.804814 16975 raft_consensus.cc:493] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.873021 16976 raft_consensus.cc:493] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.876502 16976 raft_consensus.cc:515] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:23.801003 16646 consensus_peers.cc:597] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:58:23.877424 16646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 76547.8us
I20260204 08:58:23.878799 16976 leader_election.cc:290] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
W20260204 08:58:23.878917 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:39491, user_credentials={real_user=slave}} blocked reactor thread for 70373.9us
I20260204 08:58:23.870134 16607 raft_consensus.cc:2468] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:23.880507 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06e4fe1636ad4bb8bbdbeb6009a8d41d" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:23.881661 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06e4fe1636ad4bb8bbdbeb6009a8d41d" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:23.882742 16572 leader_election.cc:343] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.883944 16975 raft_consensus.cc:515] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.806157 16723 tablet_bootstrap.cc:654] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.888392 16975 leader_election.cc:290] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.805075 16430 catalog_manager.cc:5654] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:23.886148 16974 raft_consensus.cc:493] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:58:23.886336 16646 consensus_peers.cc:597] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:23.870098 16725 consensus_queue.cc:260] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.891284 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.892448 16974 raft_consensus.cc:515] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.834779 16746 raft_consensus.cc:493] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.894371 16974 leader_election.cc:290] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.894311 16746 raft_consensus.cc:515] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.895437 16679 raft_consensus.cc:2468] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:23.896478 16746 leader_election.cc:290] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.890070 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:23.897827 16572 leader_election.cc:343] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.898316 16725 ts_tablet_manager.cc:1434] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.124s user 0.006s sys 0.000s
I20260204 08:58:23.898640 16572 leader_election.cc:304] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:23.899170 16725 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
W20260204 08:58:23.899641 16572 leader_election.cc:343] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.899811 16975 raft_consensus.cc:2804] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:23.900061 16572 leader_election.cc:304] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:23.900753 16976 raft_consensus.cc:2749] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.902092 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06e4fe1636ad4bb8bbdbeb6009a8d41d" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:23.903484 16646 leader_election.cc:343] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.904245 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:23.904196 16427 catalog_manager.cc:5654] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:23.908941 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06e4fe1636ad4bb8bbdbeb6009a8d41d" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.911696 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:23.912181 16773 consensus_queue.cc:1048] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:58:23.917637 16498 leader_election.cc:343] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.927270 16723 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:23.927772 16723 ts_tablet_manager.cc:1403] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.196s user 0.013s sys 0.004s
I20260204 08:58:23.930141 16723 raft_consensus.cc:359] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.930778 16723 raft_consensus.cc:385] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.931033 16723 raft_consensus.cc:740] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.931852 16723 consensus_queue.cc:260] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.933357 16723 ts_tablet_manager.cc:1434] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:58:23.934326 16723 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:23.942078 16725 tablet_bootstrap.cc:654] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.900310 16975 raft_consensus.cc:493] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:23.946934 16975 raft_consensus.cc:3060] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:23.948650 16722 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:23.949155 16722 ts_tablet_manager.cc:1403] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.328s user 0.014s sys 0.019s
W20260204 08:58:23.949889 16497 leader_election.cc:343] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:23.950374 16497 leader_election.cc:304] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:23.951557 16723 tablet_bootstrap.cc:654] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:23.951601 16974 raft_consensus.cc:2749] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:23.959179 16722 raft_consensus.cc:359] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.959872 16722 raft_consensus.cc:385] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:23.965255 16722 raft_consensus.cc:740] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:23.966503 16722 consensus_queue.cc:260] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.986403 16986 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:23.986891 16725 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:23.987319 16725 ts_tablet_manager.cc:1403] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.088s user 0.013s sys 0.013s
I20260204 08:58:23.991406 16722 ts_tablet_manager.cc:1434] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20260204 08:58:23.986907 16986 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.994455 16986 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:23.995776 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:23.996511 16532 raft_consensus.cc:2393] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86e16045049f4f87a94336b5d2262328 in current term 1: Already voted for candidate 35380a227e2c4fa4a063d4fd67c30b53 in this term.
I20260204 08:58:23.997270 16723 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:23.983556 16975 raft_consensus.cc:515] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:23.998114 16602 raft_consensus.cc:2393] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86e16045049f4f87a94336b5d2262328 in current term 1: Already voted for candidate f959652a42f34a81aca5da9faec0a7a3 in this term.
I20260204 08:58:23.998854 16975 leader_election.cc:290] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:23.992707 16722 tablet_bootstrap.cc:492] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:24.000326 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06e4fe1636ad4bb8bbdbeb6009a8d41d" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:24.000881 16679 raft_consensus.cc:3060] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.000785 16725 raft_consensus.cc:359] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.001474 16725 raft_consensus.cc:385] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.001762 16725 raft_consensus.cc:740] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.002568 16725 consensus_queue.cc:260] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.004760 16725 ts_tablet_manager.cc:1434] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260204 08:58:24.005573 16725 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.006017 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06e4fe1636ad4bb8bbdbeb6009a8d41d" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:24.006588 16532 raft_consensus.cc:3060] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.009025 16723 ts_tablet_manager.cc:1403] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.075s user 0.010s sys 0.003s
I20260204 08:58:24.010191 16844 consensus_queue.cc:1048] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:24.011615 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.013242 16607 raft_consensus.cc:2393] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86e16045049f4f87a94336b5d2262328 in current term 1: Already voted for candidate f959652a42f34a81aca5da9faec0a7a3 in this term.
I20260204 08:58:24.013845 16647 leader_election.cc:304] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:24.016345 16723 raft_consensus.cc:359] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.016687 16532 raft_consensus.cc:2468] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:24.017016 16723 raft_consensus.cc:385] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.017324 16723 raft_consensus.cc:740] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.017813 16572 leader_election.cc:304] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:24.017908 16723 consensus_queue.cc:260] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.018425 16976 raft_consensus.cc:2804] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:24.018965 16976 raft_consensus.cc:697] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:24.019847 16976 consensus_queue.cc:237] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.022010 16647 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:24.037671 16773 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:58:24.048518 16646 consensus_peers.cc:597] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:24.049350 16722 tablet_bootstrap.cc:654] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.056313 16723 ts_tablet_manager.cc:1434] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.045s user 0.006s sys 0.000s
I20260204 08:58:24.057279 16723 tablet_bootstrap.cc:492] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:24.057840 16725 tablet_bootstrap.cc:654] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.060482 16679 raft_consensus.cc:2468] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:24.062008 16986 raft_consensus.cc:2749] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.067253 16773 raft_consensus.cc:2749] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.077488 16723 tablet_bootstrap.cc:654] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.082908 16427 catalog_manager.cc:5654] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:24.084545 16725 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:24.087208 16725 ts_tablet_manager.cc:1403] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.082s user 0.011s sys 0.010s
I20260204 08:58:24.091589 16725 raft_consensus.cc:359] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.092347 16725 raft_consensus.cc:385] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.092666 16725 raft_consensus.cc:740] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.093386 16725 consensus_queue.cc:260] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.095538 16725 ts_tablet_manager.cc:1434] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260204 08:58:24.098373 16725 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.098842 16722 tablet_bootstrap.cc:492] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:24.099287 16722 ts_tablet_manager.cc:1403] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.107s user 0.014s sys 0.008s
I20260204 08:58:24.102360 16722 raft_consensus.cc:359] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.102999 16722 raft_consensus.cc:385] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.103256 16722 raft_consensus.cc:740] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.103518 16725 tablet_bootstrap.cc:654] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.103837 16722 consensus_queue.cc:260] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.106364 16723 tablet_bootstrap.cc:492] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:24.106824 16723 ts_tablet_manager.cc:1403] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.000s
I20260204 08:58:24.108651 16725 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:24.109095 16725 ts_tablet_manager.cc:1403] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260204 08:58:24.109095 16722 ts_tablet_manager.cc:1434] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260204 08:58:24.110181 16722 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:24.111629 16725 raft_consensus.cc:359] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.112293 16725 raft_consensus.cc:385] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.112551 16725 raft_consensus.cc:740] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.113044 16723 raft_consensus.cc:359] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.113243 16725 consensus_queue.cc:260] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.113709 16723 raft_consensus.cc:385] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.114015 16723 raft_consensus.cc:740] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.114980 16723 consensus_queue.cc:260] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.115489 16725 ts_tablet_manager.cc:1434] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260204 08:58:24.116425 16725 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.117198 16723 ts_tablet_manager.cc:1434] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.010s user 0.003s sys 0.004s
I20260204 08:58:24.118577 16723 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:24.122504 16725 tablet_bootstrap.cc:654] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.124606 16723 tablet_bootstrap.cc:654] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.125453 16722 tablet_bootstrap.cc:654] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.135977 16722 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:24.136415 16722 ts_tablet_manager.cc:1403] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.001s
I20260204 08:58:24.138341 16722 raft_consensus.cc:359] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.138953 16722 raft_consensus.cc:385] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.139170 16722 raft_consensus.cc:740] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.139634 16723 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:24.140197 16723 ts_tablet_manager.cc:1403] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.008s
I20260204 08:58:24.139732 16722 consensus_queue.cc:260] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.142117 16725 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:24.142537 16725 ts_tablet_manager.cc:1403] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.012s
I20260204 08:58:24.142624 16723 raft_consensus.cc:359] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.143272 16723 raft_consensus.cc:385] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.143520 16723 raft_consensus.cc:740] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.144063 16722 ts_tablet_manager.cc:1434] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:58:24.144131 16723 consensus_queue.cc:260] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.145413 16722 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:24.146457 16725 raft_consensus.cc:359] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.147095 16725 raft_consensus.cc:385] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.147351 16725 raft_consensus.cc:740] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.147959 16725 consensus_queue.cc:260] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.150382 16725 ts_tablet_manager.cc:1434] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:58:24.151943 16725 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.152874 16723 ts_tablet_manager.cc:1434] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260204 08:58:24.153182 16722 tablet_bootstrap.cc:654] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.153776 16723 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:24.159356 16723 tablet_bootstrap.cc:654] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.165980 16725 tablet_bootstrap.cc:654] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.166775 16976 raft_consensus.cc:493] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.167238 16976 raft_consensus.cc:515] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.169122 16976 leader_election.cc:290] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.170989 16722 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:24.171202 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.171571 16722 ts_tablet_manager.cc:1403] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.026s user 0.018s sys 0.002s
I20260204 08:58:24.171520 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:24.172260 16680 raft_consensus.cc:2468] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:24.173341 16572 leader_election.cc:304] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:24.174198 16974 raft_consensus.cc:493] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.174055 16722 raft_consensus.cc:359] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.174638 16974 raft_consensus.cc:515] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.175271 16722 raft_consensus.cc:385] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.175621 16722 raft_consensus.cc:740] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.175477 16773 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:58:24.176383 16722 consensus_queue.cc:260] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.177129 16974 leader_election.cc:290] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.179483 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457a55a8c34648f6ae2a009fcb9fd749" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.181875 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457a55a8c34648f6ae2a009fcb9fd749" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:24.182500 16725 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:24.182964 16725 ts_tablet_manager.cc:1403] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.006s
I20260204 08:58:24.184259 16497 leader_election.cc:304] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:24.185323 16796 raft_consensus.cc:2749] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.186899 16773 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:24.187453 16725 raft_consensus.cc:359] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.188081 16725 raft_consensus.cc:385] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.188258 16725 raft_consensus.cc:740] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.188637 16725 consensus_queue.cc:260] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:24.190001 16572 leader_election.cc:343] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.190182 16725 ts_tablet_manager.cc:1434] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260204 08:58:24.190835 16725 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.191032 16976 raft_consensus.cc:2804] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:24.191391 16976 raft_consensus.cc:493] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:24.192291 16976 raft_consensus.cc:3060] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.195560 16725 tablet_bootstrap.cc:654] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.187000 16722 ts_tablet_manager.cc:1434] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260204 08:58:24.199249 16722 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:24.204934 16722 tablet_bootstrap.cc:654] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.206785 16976 raft_consensus.cc:515] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.209371 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
W20260204 08:58:24.210773 16572 leader_election.cc:343] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.220129 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:24.222594 16723 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:24.223095 16723 ts_tablet_manager.cc:1403] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.069s user 0.013s sys 0.000s
I20260204 08:58:24.229985 16773 raft_consensus.cc:493] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.230587 16773 raft_consensus.cc:515] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.221537 16680 raft_consensus.cc:3060] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.221804 16976 leader_election.cc:290] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.235119 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.244414 16723 raft_consensus.cc:359] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.245126 16723 raft_consensus.cc:385] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.245383 16723 raft_consensus.cc:740] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.246049 16723 consensus_queue.cc:260] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.248108 16723 ts_tablet_manager.cc:1434] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260204 08:58:24.248272 16773 leader_election.cc:290] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.250075 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.251420 16647 leader_election.cc:304] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:24.252509 16849 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:24.255743 16986 raft_consensus.cc:2749] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.259050 16722 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:24.259496 16722 ts_tablet_manager.cc:1403] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.060s user 0.016s sys 0.003s
I20260204 08:58:24.264539 16722 raft_consensus.cc:359] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.265241 16722 raft_consensus.cc:385] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.265516 16722 raft_consensus.cc:740] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.263609 16723 tablet_bootstrap.cc:492] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:24.269605 16725 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:24.270125 16725 ts_tablet_manager.cc:1403] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.079s user 0.018s sys 0.010s
I20260204 08:58:24.270491 16722 consensus_queue.cc:260] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.276834 16725 raft_consensus.cc:359] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.277287 16680 raft_consensus.cc:2468] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:24.278810 16572 leader_election.cc:304] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:24.280205 16975 raft_consensus.cc:2804] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:24.280475 16722 ts_tablet_manager.cc:1434] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20260204 08:58:24.280642 16975 raft_consensus.cc:697] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:24.281327 16722 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:24.281546 16975 consensus_queue.cc:237] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.277518 16725 raft_consensus.cc:385] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.282934 16725 raft_consensus.cc:740] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.283551 16725 consensus_queue.cc:260] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.290827 16725 ts_tablet_manager.cc:1434] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260204 08:58:24.291533 16725 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.303033 16722 tablet_bootstrap.cc:654] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.307044 16532 raft_consensus.cc:3060] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.308745 16723 tablet_bootstrap.cc:654] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.311579 16849 raft_consensus.cc:493] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.312186 16725 tablet_bootstrap.cc:654] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.312084 16849 raft_consensus.cc:515] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.314249 16427 catalog_manager.cc:5654] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:24.315901 16601 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.317046 16601 raft_consensus.cc:2468] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:24.317966 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:24.318624 16680 raft_consensus.cc:2468] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:24.319785 16497 leader_election.cc:304] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:24.320202 16974 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:24.320605 16849 leader_election.cc:290] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.321324 16849 raft_consensus.cc:2804] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:24.321645 16849 raft_consensus.cc:493] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:24.321970 16849 raft_consensus.cc:3060] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.330847 16725 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:24.331293 16723 tablet_bootstrap.cc:492] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:24.331810 16723 ts_tablet_manager.cc:1403] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.068s user 0.011s sys 0.000s
I20260204 08:58:24.334172 16723 raft_consensus.cc:359] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.334841 16723 raft_consensus.cc:385] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.335094 16723 raft_consensus.cc:740] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.331313 16725 ts_tablet_manager.cc:1403] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.000s
I20260204 08:58:24.338573 16725 raft_consensus.cc:359] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.339233 16725 raft_consensus.cc:385] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.339735 16723 consensus_queue.cc:260] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.342001 16723 ts_tablet_manager.cc:1434] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260204 08:58:24.342939 16723 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:24.339489 16725 raft_consensus.cc:740] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.344271 16725 consensus_queue.cc:260] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.346381 16725 ts_tablet_manager.cc:1434] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.010s user 0.002s sys 0.002s
I20260204 08:58:24.347270 16725 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.348219 16849 raft_consensus.cc:515] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.351061 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:24.351383 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:24.351621 16607 raft_consensus.cc:3060] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.351943 16679 raft_consensus.cc:3060] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.355372 16849 leader_election.cc:290] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.357980 16679 raft_consensus.cc:2468] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:24.359175 16497 leader_election.cc:304] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:24.362869 16849 raft_consensus.cc:2804] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:24.363986 16849 raft_consensus.cc:697] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:24.365110 16723 tablet_bootstrap.cc:654] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.364873 16849 consensus_queue.cc:237] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.365569 16975 raft_consensus.cc:493] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.368417 16975 raft_consensus.cc:515] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.369791 16607 raft_consensus.cc:2468] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:24.370395 16975 leader_election.cc:290] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.371114 16910 raft_consensus.cc:493] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.371541 16910 raft_consensus.cc:515] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.373643 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.373941 16910 leader_election.cc:290] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.374241 16530 raft_consensus.cc:2468] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:24.374706 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.361234 16986 raft_consensus.cc:493] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.375773 16572 leader_election.cc:304] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
W20260204 08:58:24.376143 16646 leader_election.cc:343] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.375968 16986 raft_consensus.cc:515] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.376637 16779 raft_consensus.cc:493] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.377074 16779 raft_consensus.cc:515] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.378110 16986 leader_election.cc:290] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.378795 16779 leader_election.cc:290] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.379302 16779 raft_consensus.cc:2804] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:24.379863 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.380455 16529 raft_consensus.cc:2468] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:24.381524 16646 leader_election.cc:304] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:24.382411 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:24.383616 16572 leader_election.cc:343] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.384410 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.382903 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:24.385579 16572 leader_election.cc:343] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.386051 16572 leader_election.cc:304] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:24.387073 16975 raft_consensus.cc:2749] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.385118 16679 raft_consensus.cc:2468] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:24.383848 16844 raft_consensus.cc:2804] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:24.388826 16844 raft_consensus.cc:493] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:24.389185 16844 raft_consensus.cc:3060] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.387522 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.388362 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.379611 16779 raft_consensus.cc:493] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:24.394815 16607 raft_consensus.cc:2468] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:24.392444 16604 raft_consensus.cc:2468] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:24.393064 16779 raft_consensus.cc:3060] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.396955 16647 leader_election.cc:304] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:24.398319 16725 tablet_bootstrap.cc:654] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.398691 16910 raft_consensus.cc:2804] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:24.399111 16910 raft_consensus.cc:493] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:24.399490 16910 raft_consensus.cc:3060] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.415885 16844 raft_consensus.cc:515] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.422216 16722 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:24.422703 16722 ts_tablet_manager.cc:1403] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.142s user 0.033s sys 0.038s
I20260204 08:58:24.424974 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:24.425593 16844 leader_election.cc:290] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.425680 16532 raft_consensus.cc:3060] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.426482 16779 raft_consensus.cc:515] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.429762 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:24.430390 16602 raft_consensus.cc:3060] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.431254 16722 raft_consensus.cc:359] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.431989 16722 raft_consensus.cc:385] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.432251 16722 raft_consensus.cc:740] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.432842 16722 consensus_queue.cc:260] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.439610 16722 ts_tablet_manager.cc:1434] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.017s user 0.003s sys 0.003s
I20260204 08:58:24.440104 16602 raft_consensus.cc:2468] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:24.440582 16722 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:24.441360 16532 raft_consensus.cc:2468] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:24.442524 16646 leader_election.cc:304] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:24.450363 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:24.450551 16975 raft_consensus.cc:493] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.451046 16532 raft_consensus.cc:3060] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.467944 16910 raft_consensus.cc:515] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.469777 16779 leader_election.cc:290] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.477943 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:24.478565 16679 raft_consensus.cc:3060] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.451128 16975 raft_consensus.cc:515] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.486086 16679 raft_consensus.cc:2468] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:24.516548 16532 raft_consensus.cc:2468] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:24.447883 16844 raft_consensus.cc:2804] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:24.541322 16572 leader_election.cc:304] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:24.486044 16429 catalog_manager.cc:5654] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:24.512243 16746 raft_consensus.cc:493] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.552407 16976 raft_consensus.cc:2804] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:24.542655 16846 raft_consensus.cc:493] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.538547 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:24.512120 16849 raft_consensus.cc:493] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.511474 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.559178 16846 raft_consensus.cc:515] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.544757 16910 leader_election.cc:290] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.561237 16846 leader_election.cc:290] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.561355 16976 raft_consensus.cc:697] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:24.559245 16849 raft_consensus.cc:515] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.562167 16976 consensus_queue.cc:237] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.563716 16849 leader_election.cc:290] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.564015 16910 raft_consensus.cc:493] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.564479 16910 raft_consensus.cc:515] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.566344 16910 leader_election.cc:290] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
W20260204 08:58:24.566608 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:58:24.545397 16975 leader_election.cc:290] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.556273 16844 raft_consensus.cc:697] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:24.558269 16746 raft_consensus.cc:515] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.587626 16725 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:24.588092 16725 ts_tablet_manager.cc:1403] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.241s user 0.020s sys 0.016s
W20260204 08:58:24.589064 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 47823.4us
W20260204 08:58:24.592512 16646 leader_election.cc:343] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.594265 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:24.594988 16723 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:24.595391 16723 ts_tablet_manager.cc:1403] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.253s user 0.016s sys 0.014s
W20260204 08:58:24.597159 16572 leader_election.cc:343] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.591593 16746 leader_election.cc:290] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.601333 16725 raft_consensus.cc:359] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.601788 16725 raft_consensus.cc:385] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.601984 16725 raft_consensus.cc:740] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.602458 16725 consensus_queue.cc:260] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.602455 16844 consensus_queue.cc:237] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.608248 16725 ts_tablet_manager.cc:1434] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260204 08:58:24.611603 16909 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:58:24.613538 16572 leader_election.cc:343] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.613927 16572 leader_election.cc:304] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:24.610693 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "796b324679b4492db7f68598b0a2d4e2" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.617487 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.617718 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:24.624516 16725 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.626091 16846 raft_consensus.cc:493] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.626264 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2e4ca7bedb84f7ba570333f98fb5de5" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.626613 16846 raft_consensus.cc:515] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.628130 16532 raft_consensus.cc:3060] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.628492 16846 leader_election.cc:290] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
W20260204 08:58:24.630465 16646 leader_election.cc:343] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.630362 16529 raft_consensus.cc:2468] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:24.616106 17017 raft_consensus.cc:2749] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.652776 16723 raft_consensus.cc:359] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.656208 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:24.656370 16723 raft_consensus.cc:385] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.656683 16723 raft_consensus.cc:740] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.657768 16722 tablet_bootstrap.cc:654] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.660732 16723 consensus_queue.cc:260] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.637864 16975 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260204 08:58:24.667601 16497 leader_election.cc:343] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.666708 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2e4ca7bedb84f7ba570333f98fb5de5" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:24.668488 16679 raft_consensus.cc:2468] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:24.670293 16497 leader_election.cc:304] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:24.676251 16723 ts_tablet_manager.cc:1434] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.081s user 0.007s sys 0.000s
I20260204 08:58:24.677176 16723 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:24.678565 16725 tablet_bootstrap.cc:654] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.689427 17025 raft_consensus.cc:2804] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:24.689827 17025 raft_consensus.cc:493] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:24.690147 17025 raft_consensus.cc:3060] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.695209 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:24.695879 16607 raft_consensus.cc:3060] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.697009 17025 raft_consensus.cc:515] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.699020 17025 leader_election.cc:290] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
W20260204 08:58:24.684729 16498 leader_election.cc:343] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.665021 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2e4ca7bedb84f7ba570333f98fb5de5" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.699963 16498 leader_election.cc:304] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:24.703496 16796 raft_consensus.cc:2749] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.706261 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2e4ca7bedb84f7ba570333f98fb5de5" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:24.706848 16680 raft_consensus.cc:3060] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.706887 16427 catalog_manager.cc:5654] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:24.702679 16602 raft_consensus.cc:2468] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:24.728819 16681 raft_consensus.cc:3060] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.734515 16680 raft_consensus.cc:2468] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:24.737414 16497 leader_election.cc:304] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:24.739845 16725 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:24.741004 16725 ts_tablet_manager.cc:1403] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.117s user 0.016s sys 0.009s
I20260204 08:58:24.745797 16646 leader_election.cc:304] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:24.746642 16773 raft_consensus.cc:2764] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260204 08:58:24.749688 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.750264 16601 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "796b324679b4492db7f68598b0a2d4e2" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.751298 16429 catalog_manager.cc:5654] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:24.753259 16601 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2e4ca7bedb84f7ba570333f98fb5de5" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.754438 16601 raft_consensus.cc:2468] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:24.760535 16723 tablet_bootstrap.cc:654] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.766215 16725 raft_consensus.cc:359] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.766880 16725 raft_consensus.cc:385] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.767122 16725 raft_consensus.cc:740] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.767750 16725 consensus_queue.cc:260] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.762661 16607 raft_consensus.cc:2468] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:24.768540 17025 raft_consensus.cc:2804] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:24.780503 16725 ts_tablet_manager.cc:1434] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260204 08:58:24.781435 16725 tablet_bootstrap.cc:492] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.787339 17024 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260204 08:58:24.793601 16725 tablet_bootstrap.cc:654] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.783547 17025 raft_consensus.cc:697] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:24.806767 16722 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:24.807232 16722 ts_tablet_manager.cc:1403] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.367s user 0.012s sys 0.036s
I20260204 08:58:24.808413 16498 leader_election.cc:304] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
W20260204 08:58:24.807857 16647 leader_election.cc:343] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.809692 16647 leader_election.cc:304] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:24.811308 16722 raft_consensus.cc:359] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.811936 16723 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:24.812371 16723 ts_tablet_manager.cc:1403] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.135s user 0.010s sys 0.012s
I20260204 08:58:24.811965 16722 raft_consensus.cc:385] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.812862 16722 raft_consensus.cc:740] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.814378 16844 raft_consensus.cc:2749] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.818457 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2e4ca7bedb84f7ba570333f98fb5de5" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:24.819008 16607 raft_consensus.cc:3060] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.819717 16723 raft_consensus.cc:359] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.820334 16723 raft_consensus.cc:385] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.820688 16723 raft_consensus.cc:740] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.821282 16723 consensus_queue.cc:260] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.801841 17025 consensus_queue.cc:237] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.823508 16723 ts_tablet_manager.cc:1434] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260204 08:58:24.824765 16723 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:24.824541 16647 leader_election.cc:304] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:24.825762 16722 consensus_queue.cc:260] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.814512 16846 raft_consensus.cc:2749] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.829742 16986 raft_consensus.cc:2804] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:24.859887 16722 ts_tablet_manager.cc:1434] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.052s user 0.007s sys 0.001s
I20260204 08:58:24.861213 16722 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:24.870509 16607 raft_consensus.cc:2468] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:24.887918 17035 raft_consensus.cc:493] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.889295 16975 raft_consensus.cc:493] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.888487 17035 raft_consensus.cc:515] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.903192 16975 raft_consensus.cc:515] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.906721 16986 raft_consensus.cc:697] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:24.911327 17035 leader_election.cc:290] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.913277 16529 raft_consensus.cc:3060] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.913640 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c77c8d18f5274899a308f09e7aa99de3" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.914834 16975 leader_election.cc:290] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:24.920301 16725 tablet_bootstrap.cc:492] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
W20260204 08:58:24.914673 16572 consensus_peers.cc:597] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:58:24.925650 17031 log.cc:927] Time spent T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53: Append to log took a long time: real 0.062s user 0.001s sys 0.000s
I20260204 08:58:24.926054 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "796b324679b4492db7f68598b0a2d4e2" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.927299 16723 tablet_bootstrap.cc:654] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
W20260204 08:58:24.927841 16646 leader_election.cc:343] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:24.928217 16572 leader_election.cc:343] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.930657 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "796b324679b4492db7f68598b0a2d4e2" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:24.931486 16725 ts_tablet_manager.cc:1403] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.150s user 0.028s sys 0.022s
I20260204 08:58:24.932188 16680 raft_consensus.cc:2468] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:24.931140 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c77c8d18f5274899a308f09e7aa99de3" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.930053 16430 catalog_manager.cc:5654] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:24.936475 16572 leader_election.cc:304] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:24.934043 16986 consensus_queue.cc:237] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.942934 16725 raft_consensus.cc:359] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.943603 16725 raft_consensus.cc:385] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:24.943886 16725 raft_consensus.cc:740] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:24.944453 16725 consensus_queue.cc:260] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:24.935451 16647 leader_election.cc:343] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.945942 16647 leader_election.cc:304] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:24.947067 16725 ts_tablet_manager.cc:1434] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260204 08:58:24.948791 16725 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:24.949353 16976 raft_consensus.cc:2804] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:24.949713 16976 raft_consensus.cc:493] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:24.949795 17035 raft_consensus.cc:493] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.950052 16976 raft_consensus.cc:3060] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:24.950253 16734 raft_consensus.cc:493] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:24.950670 16734 raft_consensus.cc:515] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.957320 17037 raft_consensus.cc:2749] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:24.958488 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.957276 17035 raft_consensus.cc:515] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:24.960310 16646 leader_election.cc:343] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.961380 16734 leader_election.cc:290] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.964288 16723 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:24.965394 16723 ts_tablet_manager.cc:1403] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.141s user 0.010s sys 0.008s
W20260204 08:58:24.968493 17033 log.cc:927] Time spent T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328: Append to log took a long time: real 0.073s user 0.000s sys 0.001s
I20260204 08:58:24.975396 16976 raft_consensus.cc:515] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:24.979698 16722 tablet_bootstrap.cc:654] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:24.979737 17035 leader_election.cc:290] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:24.980563 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:24.983529 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
W20260204 08:58:24.983980 16646 leader_election.cc:343] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:24.987919 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:24.988595 16602 raft_consensus.cc:2468] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:24.990365 17024 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:24.994175 16725 tablet_bootstrap.cc:654] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
W20260204 08:58:24.999889 16647 leader_election.cc:343] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.000315 16647 leader_election.cc:304] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:25.010775 17035 raft_consensus.cc:2749] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:25.015596 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "796b324679b4492db7f68598b0a2d4e2" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:25.021154 16723 raft_consensus.cc:359] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.021847 16723 raft_consensus.cc:385] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260204 08:58:25.022019 16572 leader_election.cc:343] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.022086 16723 raft_consensus.cc:740] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.023458 16430 catalog_manager.cc:5654] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:25.037813 16723 consensus_queue.cc:260] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.040402 16723 ts_tablet_manager.cc:1434] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.075s user 0.006s sys 0.001s
I20260204 08:58:25.041301 16723 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:25.001695 16647 leader_election.cc:304] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:25.044836 17037 raft_consensus.cc:2804] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:25.045178 17037 raft_consensus.cc:493] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.045485 17037 raft_consensus.cc:3060] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.034147 16976 leader_election.cc:290] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.032495 17023 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260204 08:58:25.047881 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "796b324679b4492db7f68598b0a2d4e2" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:25.050828 16680 raft_consensus.cc:3060] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.057929 16722 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.058522 16796 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:58:25.063062 16722 ts_tablet_manager.cc:1403] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.202s user 0.027s sys 0.038s
I20260204 08:58:25.063516 16723 tablet_bootstrap.cc:654] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.065456 16722 raft_consensus.cc:359] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.066099 16722 raft_consensus.cc:385] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.066380 16722 raft_consensus.cc:740] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.068135 17037 raft_consensus.cc:515] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.069630 16722 consensus_queue.cc:260] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.072237 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
W20260204 08:58:25.073362 16646 leader_election.cc:343] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.073716 16722 ts_tablet_manager.cc:1434] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.010s user 0.000s sys 0.005s
I20260204 08:58:25.074723 16725 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:25.075201 16725 ts_tablet_manager.cc:1403] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.127s user 0.016s sys 0.006s
I20260204 08:58:25.071220 17037 leader_election.cc:290] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:25.086879 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:25.087464 16607 raft_consensus.cc:3060] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.088224 16722 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.091097 17037 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.090251 16725 raft_consensus.cc:359] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.095736 16680 raft_consensus.cc:2468] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:25.095369 16725 raft_consensus.cc:385] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.099220 16725 raft_consensus.cc:740] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.099972 16725 consensus_queue.cc:260] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.102769 16725 ts_tablet_manager.cc:1434] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20260204 08:58:25.107180 16572 leader_election.cc:304] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:25.108156 17026 raft_consensus.cc:2804] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:25.108645 17026 raft_consensus.cc:697] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:25.095729 16607 raft_consensus.cc:2468] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:25.109503 17026 consensus_queue.cc:237] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.110172 16722 tablet_bootstrap.cc:654] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.110646 16725 tablet_bootstrap.cc:492] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:25.116881 16647 leader_election.cc:304] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:25.118690 17037 raft_consensus.cc:2804] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:25.119148 17037 raft_consensus.cc:697] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:25.119912 17037 consensus_queue.cc:237] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.120414 16723 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:25.124790 16723 ts_tablet_manager.cc:1403] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.084s user 0.010s sys 0.001s
I20260204 08:58:25.127419 16723 raft_consensus.cc:359] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.128530 17024 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.135746 16723 raft_consensus.cc:385] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.136101 16723 raft_consensus.cc:740] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.136996 16723 consensus_queue.cc:260] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.133905 16725 tablet_bootstrap.cc:654] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.143568 16722 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.143676 16723 ts_tablet_manager.cc:1434] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260204 08:58:25.144110 16722 ts_tablet_manager.cc:1403] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.056s user 0.012s sys 0.014s
I20260204 08:58:25.144716 16723 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:25.146755 16722 raft_consensus.cc:359] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.147383 16722 raft_consensus.cc:385] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.147640 16722 raft_consensus.cc:740] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.148314 16722 consensus_queue.cc:260] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.149902 16722 ts_tablet_manager.cc:1434] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260204 08:58:25.150772 16722 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.156792 16722 tablet_bootstrap.cc:654] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.160331 16723 tablet_bootstrap.cc:654] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.167953 16722 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.168411 16722 ts_tablet_manager.cc:1403] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.018s user 0.016s sys 0.000s
I20260204 08:58:25.171213 16722 raft_consensus.cc:359] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.172099 16722 raft_consensus.cc:385] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.172654 16722 raft_consensus.cc:740] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.173221 16722 consensus_queue.cc:260] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:25.174257 16647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 57456.5us
I20260204 08:58:25.176523 16722 ts_tablet_manager.cc:1434] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:58:25.177467 16722 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.188984 16722 tablet_bootstrap.cc:654] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.197420 16427 catalog_manager.cc:5654] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:25.204730 16722 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.205147 16722 ts_tablet_manager.cc:1403] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.007s
I20260204 08:58:25.208761 16722 raft_consensus.cc:359] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.209352 16722 raft_consensus.cc:385] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.209605 16722 raft_consensus.cc:740] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.210865 16722 consensus_queue.cc:260] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.212390 16722 ts_tablet_manager.cc:1434] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260204 08:58:25.213222 16722 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.217963 16734 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.226887 16722 tablet_bootstrap.cc:654] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.227571 16846 raft_consensus.cc:493] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.228046 16846 raft_consensus.cc:515] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.229923 16846 leader_election.cc:290] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.230376 16725 tablet_bootstrap.cc:492] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:25.230806 16725 ts_tablet_manager.cc:1403] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.120s user 0.017s sys 0.024s
I20260204 08:58:25.233103 16725 raft_consensus.cc:359] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.233337 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.233722 16725 raft_consensus.cc:385] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.233938 16680 raft_consensus.cc:2468] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:25.234000 16725 raft_consensus.cc:740] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.234915 16725 consensus_queue.cc:260] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.235488 16497 leader_election.cc:304] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:25.236238 17022 raft_consensus.cc:2804] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:25.236577 17022 raft_consensus.cc:493] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.236887 17022 raft_consensus.cc:3060] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.237082 16723 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:25.237498 16723 ts_tablet_manager.cc:1403] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.093s user 0.008s sys 0.031s
I20260204 08:58:25.239394 17026 raft_consensus.cc:493] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.239634 16725 ts_tablet_manager.cc:1434] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20260204 08:58:25.239869 17026 raft_consensus.cc:515] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.240916 16725 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:25.245409 16722 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.245839 16722 ts_tablet_manager.cc:1403] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.005s
I20260204 08:58:25.246243 17022 raft_consensus.cc:515] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.246667 17026 leader_election.cc:290] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.249316 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82c2a342cc8c4de99746b3951b711b0c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
W20260204 08:58:25.250705 16572 leader_election.cc:343] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.251060 16723 raft_consensus.cc:359] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.251751 16723 raft_consensus.cc:385] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.251996 16723 raft_consensus.cc:740] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.252552 16723 consensus_queue.cc:260] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.241458 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.253298 17023 raft_consensus.cc:493] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.260141 17023 raft_consensus.cc:515] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.261197 16725 tablet_bootstrap.cc:654] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.261935 17023 leader_election.cc:290] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.254208 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82c2a342cc8c4de99746b3951b711b0c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.262872 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.256052 17024 raft_consensus.cc:493] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.253188 16429 catalog_manager.cc:5654] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
W20260204 08:58:25.259621 16498 leader_election.cc:343] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.253266 17022 leader_election.cc:290] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.265770 16725 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:25.256510 16723 ts_tablet_manager.cc:1434] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.019s user 0.002s sys 0.005s
I20260204 08:58:25.266571 16725 ts_tablet_manager.cc:1403] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.004s
I20260204 08:58:25.264266 17024 raft_consensus.cc:515] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.256981 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:25.267078 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.267825 16607 raft_consensus.cc:2393] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35380a227e2c4fa4a063d4fd67c30b53 in current term 1: Already voted for candidate 86e16045049f4f87a94336b5d2262328 in this term.
I20260204 08:58:25.258092 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:25.268868 16680 raft_consensus.cc:3060] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.255280 16722 raft_consensus.cc:359] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.271579 16722 raft_consensus.cc:385] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.271903 16722 raft_consensus.cc:740] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.272732 16723 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:25.272584 16722 consensus_queue.cc:260] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.275148 16722 ts_tablet_manager.cc:1434] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.029s user 0.005s sys 0.001s
I20260204 08:58:25.277552 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c77c8d18f5274899a308f09e7aa99de3" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.278170 16681 raft_consensus.cc:2468] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:25.279989 16723 tablet_bootstrap.cc:654] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.280827 16722 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.269853 16725 raft_consensus.cc:359] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.271210 17024 leader_election.cc:290] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.281185 16680 raft_consensus.cc:2468] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:25.283051 16572 leader_election.cc:304] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.284337 17024 raft_consensus.cc:2804] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260204 08:58:25.284423 16572 leader_election.cc:343] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.284749 17024 raft_consensus.cc:493] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.284854 16572 leader_election.cc:304] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:25.285126 17024 raft_consensus.cc:3060] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.286042 17026 raft_consensus.cc:2749] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:25.287868 16722 tablet_bootstrap.cc:654] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.292070 17024 raft_consensus.cc:515] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.293740 17024 leader_election.cc:290] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.282835 16725 raft_consensus.cc:385] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.294461 16725 raft_consensus.cc:740] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.295086 16725 consensus_queue.cc:260] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:25.283146 16498 leader_election.cc:343] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.297464 16725 ts_tablet_manager.cc:1434] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260204 08:58:25.298228 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c77c8d18f5274899a308f09e7aa99de3" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.298785 16532 raft_consensus.cc:2468] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:25.299024 16497 leader_election.cc:304] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:25.299508 16725 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:25.300202 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c77c8d18f5274899a308f09e7aa99de3" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:25.300721 16680 raft_consensus.cc:3060] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.300796 16846 raft_consensus.cc:2804] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:25.300963 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c77c8d18f5274899a308f09e7aa99de3" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:25.301462 16532 raft_consensus.cc:3060] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.301469 16846 raft_consensus.cc:697] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:25.304503 16723 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:25.304992 16723 ts_tablet_manager.cc:1403] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.003s
I20260204 08:58:25.302531 16846 consensus_queue.cc:237] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.325554 16722 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.326012 16722 ts_tablet_manager.cc:1403] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.011s
I20260204 08:58:25.333177 16723 raft_consensus.cc:359] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.333844 16723 raft_consensus.cc:385] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.334086 16723 raft_consensus.cc:740] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.334656 16723 consensus_queue.cc:260] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.335523 16680 raft_consensus.cc:2468] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:25.337204 16723 ts_tablet_manager.cc:1434] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.032s user 0.014s sys 0.011s
I20260204 08:58:25.337312 16722 raft_consensus.cc:359] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.338222 16722 raft_consensus.cc:385] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.338158 16723 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:25.338666 16722 raft_consensus.cc:740] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.339274 16722 consensus_queue.cc:260] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.340283 16498 leader_election.cc:304] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:25.343755 16723 tablet_bootstrap.cc:654] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.341120 16846 raft_consensus.cc:3060] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.345283 16722 ts_tablet_manager.cc:1434] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.019s user 0.004s sys 0.006s
I20260204 08:58:25.346163 16722 tablet_bootstrap.cc:492] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.347923 16725 tablet_bootstrap.cc:654] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
W20260204 08:58:25.348265 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 45075us
I20260204 08:58:25.348852 16532 raft_consensus.cc:2468] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:25.354965 16846 raft_consensus.cc:2749] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:25.358213 16572 leader_election.cc:304] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.358879 17026 raft_consensus.cc:2804] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:25.359826 17026 raft_consensus.cc:697] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:25.360954 16723 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:25.361536 16723 ts_tablet_manager.cc:1403] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.007s
I20260204 08:58:25.363061 16532 raft_consensus.cc:3060] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.364370 16909 raft_consensus.cc:493] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.364589 16723 raft_consensus.cc:359] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.364815 16909 raft_consensus.cc:515] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.365211 16723 raft_consensus.cc:385] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.365465 16723 raft_consensus.cc:740] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.360634 17026 consensus_queue.cc:237] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.366192 16723 consensus_queue.cc:260] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.366649 16722 tablet_bootstrap.cc:654] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.366621 16909 leader_election.cc:290] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.368554 16723 ts_tablet_manager.cc:1434] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260204 08:58:25.369040 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.369390 16723 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:25.369778 16680 raft_consensus.cc:2393] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f959652a42f34a81aca5da9faec0a7a3 in current term 1: Already voted for candidate 35380a227e2c4fa4a063d4fd67c30b53 in this term.
I20260204 08:58:25.369065 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.372292 16572 leader_election.cc:304] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:25.373001 16909 raft_consensus.cc:3060] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.380391 16909 raft_consensus.cc:2749] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:25.385645 16430 catalog_manager.cc:5654] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:25.386847 16723 tablet_bootstrap.cc:654] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.387871 17023 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.413322 16725 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:25.413789 16725 ts_tablet_manager.cc:1403] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.114s user 0.010s sys 0.009s
I20260204 08:58:25.418056 16725 raft_consensus.cc:359] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.418704 16725 raft_consensus.cc:385] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.418509 16796 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.419003 16725 raft_consensus.cc:740] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.420320 16725 consensus_queue.cc:260] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.425410 16725 ts_tablet_manager.cc:1434] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260204 08:58:25.425519 16846 raft_consensus.cc:493] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.426026 16846 raft_consensus.cc:515] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.427944 16846 leader_election.cc:290] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.428534 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35fde83161df49e09eb28ee05a4ad35f" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.428850 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35fde83161df49e09eb28ee05a4ad35f" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.433255 16607 raft_consensus.cc:2468] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
W20260204 08:58:25.433885 16497 leader_election.cc:343] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.434665 16498 leader_election.cc:304] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:25.427482 16725 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:25.435371 16723 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:25.435870 16723 ts_tablet_manager.cc:1403] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.067s user 0.012s sys 0.016s
I20260204 08:58:25.435814 16796 raft_consensus.cc:2804] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:25.436254 16796 raft_consensus.cc:493] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.436583 16796 raft_consensus.cc:3060] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.439229 16723 raft_consensus.cc:359] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.439881 16723 raft_consensus.cc:385] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.440150 16723 raft_consensus.cc:740] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.440745 16723 consensus_queue.cc:260] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.432528 16722 tablet_bootstrap.cc:492] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.441496 16734 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.442045 16722 ts_tablet_manager.cc:1403] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.096s user 0.008s sys 0.025s
I20260204 08:58:25.444177 16723 ts_tablet_manager.cc:1434] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260204 08:58:25.444283 16722 raft_consensus.cc:359] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.444917 16722 raft_consensus.cc:385] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.445158 16722 raft_consensus.cc:740] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.445711 16722 consensus_queue.cc:260] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.447145 16734 raft_consensus.cc:493] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.447811 16722 ts_tablet_manager.cc:1434] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260204 08:58:25.447590 16734 raft_consensus.cc:515] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.449128 16722 tablet_bootstrap.cc:492] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.449249 16734 leader_election.cc:290] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:25.451213 16725 tablet_bootstrap.cc:654] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.451407 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.452057 16529 raft_consensus.cc:2468] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:25.453168 16646 leader_election.cc:304] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:25.454782 16734 raft_consensus.cc:2804] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:25.455096 16734 raft_consensus.cc:493] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.455386 16734 raft_consensus.cc:3060] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.457221 16722 tablet_bootstrap.cc:654] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.457261 16846 raft_consensus.cc:493] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.459576 16846 raft_consensus.cc:515] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.461386 16846 leader_election.cc:290] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.462917 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "796b324679b4492db7f68598b0a2d4e2" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.463624 16680 raft_consensus.cc:2393] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35380a227e2c4fa4a063d4fd67c30b53 in current term 1: Already voted for candidate f959652a42f34a81aca5da9faec0a7a3 in this term.
I20260204 08:58:25.467159 16734 raft_consensus.cc:515] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.469524 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:25.470045 16529 raft_consensus.cc:3060] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.477506 16529 raft_consensus.cc:2468] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:25.478364 16722 tablet_bootstrap.cc:492] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.478329 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.478963 16722 ts_tablet_manager.cc:1403] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.030s user 0.012s sys 0.002s
I20260204 08:58:25.479794 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "796b324679b4492db7f68598b0a2d4e2" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.481961 16722 raft_consensus.cc:359] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.482632 16722 raft_consensus.cc:385] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.484308 16722 raft_consensus.cc:740] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.484757 16722 consensus_queue.cc:260] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.485293 16430 catalog_manager.cc:5654] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:25.486124 16722 ts_tablet_manager.cc:1434] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.000s sys 0.004s
I20260204 08:58:25.486992 16722 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.478977 16602 raft_consensus.cc:2468] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:25.488422 17037 raft_consensus.cc:493] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.488873 17037 raft_consensus.cc:515] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.490629 17037 leader_election.cc:290] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:25.498616 17039 raft_consensus.cc:493] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.499112 17039 raft_consensus.cc:515] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.499586 16722 tablet_bootstrap.cc:654] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.492702 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.505479 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
W20260204 08:58:25.508728 16647 leader_election.cc:343] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.493281 16796 raft_consensus.cc:515] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.512308 17039 leader_election.cc:290] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:25.513902 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.515069 16531 raft_consensus.cc:2468] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:25.516531 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.517102 16602 raft_consensus.cc:2468] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:25.521131 16647 leader_election.cc:304] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.521632 16796 leader_election.cc:290] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.521872 17039 raft_consensus.cc:2804] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:25.522228 17039 raft_consensus.cc:493] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.522535 17039 raft_consensus.cc:3060] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.524179 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35fde83161df49e09eb28ee05a4ad35f" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
W20260204 08:58:25.526098 16497 leader_election.cc:343] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.527251 16498 leader_election.cc:304] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:25.528370 16846 raft_consensus.cc:3060] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.535563 16846 raft_consensus.cc:2749] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:25.538556 17026 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.545702 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35fde83161df49e09eb28ee05a4ad35f" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:25.546276 16602 raft_consensus.cc:3060] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.549635 16722 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.550127 16722 ts_tablet_manager.cc:1403] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.063s user 0.027s sys 0.024s
I20260204 08:58:25.552738 16722 raft_consensus.cc:359] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.553393 16722 raft_consensus.cc:385] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.553670 16722 raft_consensus.cc:740] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.554698 16722 consensus_queue.cc:260] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.557005 16722 ts_tablet_manager.cc:1434] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260204 08:58:25.557957 16722 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.559911 16986 raft_consensus.cc:493] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.560385 16986 raft_consensus.cc:515] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.562721 16986 leader_election.cc:290] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:25.565724 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82c2a342cc8c4de99746b3951b711b0c" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.566378 16604 raft_consensus.cc:2468] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:25.566545 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82c2a342cc8c4de99746b3951b711b0c" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.568293 16722 tablet_bootstrap.cc:654] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.568727 16647 leader_election.cc:304] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.569491 16986 raft_consensus.cc:2804] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:25.570204 16986 raft_consensus.cc:493] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.570534 16986 raft_consensus.cc:3060] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.577157 17026 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.577665 17026 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.579980 16722 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.580263 16723 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:25.580466 16722 ts_tablet_manager.cc:1403] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.005s
I20260204 08:58:25.580768 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.581347 16680 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:25.582369 16572 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.583032 16909 raft_consensus.cc:2804] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:58:25.583381 16909 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.583881 16909 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:25.583292 16722 raft_consensus.cc:359] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.584295 16722 raft_consensus.cc:385] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.584586 16722 raft_consensus.cc:740] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.585076 16646 leader_election.cc:304] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:25.585201 16722 consensus_queue.cc:260] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.586098 17035 raft_consensus.cc:2804] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:25.588202 17037 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:58:25.589854 16646 leader_election.cc:343] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.590274 16646 leader_election.cc:304] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:25.590814 16909 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.591729 17026 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.593003 17037 raft_consensus.cc:2749] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:25.598270 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:25.598857 16532 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:25.605648 16532 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:25.606479 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.607064 16531 raft_consensus.cc:2376] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2. Re-sending same reply.
I20260204 08:58:25.608916 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:25.609421 16680 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:25.615859 16680 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:25.616991 16572 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.618237 17026 raft_consensus.cc:2804] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:25.618857 17026 raft_consensus.cc:697] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:25.619752 16909 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.619616 17026 consensus_queue.cc:237] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.623919 16909 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:58:25.648931 16646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 59103.9us
I20260204 08:58:25.639185 17035 raft_consensus.cc:697] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:25.655007 17035 consensus_queue.cc:237] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.661057 16734 leader_election.cc:290] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
W20260204 08:58:25.676155 16646 leader_election.cc:343] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.684639 17039 raft_consensus.cc:515] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.686661 17039 leader_election.cc:290] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:25.694656 16846 raft_consensus.cc:493] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.695245 16846 raft_consensus.cc:515] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.696622 16722 ts_tablet_manager.cc:1434] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.116s user 0.023s sys 0.066s
I20260204 08:58:25.697536 16722 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.699465 16723 tablet_bootstrap.cc:654] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.705665 16722 tablet_bootstrap.cc:654] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.710201 16602 raft_consensus.cc:2468] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:25.710986 16796 raft_consensus.cc:493] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.714259 16722 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.714748 16722 ts_tablet_manager.cc:1403] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.004s
I20260204 08:58:25.715811 16986 raft_consensus.cc:515] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.717202 16722 raft_consensus.cc:359] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.717891 16722 raft_consensus.cc:385] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.718137 16722 raft_consensus.cc:740] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.718726 16722 consensus_queue.cc:260] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.719588 16605 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:25.720152 16605 raft_consensus.cc:3060] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.720198 16498 leader_election.cc:304] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:25.720857 16722 ts_tablet_manager.cc:1434] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260204 08:58:25.721462 17022 raft_consensus.cc:2804] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:25.721905 17022 raft_consensus.cc:697] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:25.722645 17022 consensus_queue.cc:237] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.724066 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:25.724684 16604 raft_consensus.cc:3060] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.711465 16796 raft_consensus.cc:515] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.726325 16605 raft_consensus.cc:2468] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:25.726830 16796 leader_election.cc:290] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.727696 17079 consensus_queue.cc:1048] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.730276 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82c2a342cc8c4de99746b3951b711b0c" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:25.730820 16601 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.736104 16602 raft_consensus.cc:3060] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.734719 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.741681 16846 leader_election.cc:290] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.735392 16604 raft_consensus.cc:2468] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:25.731418 16647 leader_election.cc:304] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.742745 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.743333 16680 raft_consensus.cc:2468] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:25.742888 17078 raft_consensus.cc:2804] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:25.744148 17078 raft_consensus.cc:697] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:25.744347 16602 raft_consensus.cc:2468] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:25.744371 16497 leader_election.cc:304] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:25.745004 17078 consensus_queue.cc:237] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.745651 16846 raft_consensus.cc:2804] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:25.746138 16846 raft_consensus.cc:493] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:25.746536 16846 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.747025 16498 leader_election.cc:304] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:25.748733 17023 raft_consensus.cc:2749] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:25.749831 16601 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:25.751742 16722 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
W20260204 08:58:25.752974 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260204 08:58:25.755920 16498 leader_election.cc:343] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.774235 16722 tablet_bootstrap.cc:654] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:25.778584 16647 leader_election.cc:304] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.780189 17079 raft_consensus.cc:2804] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:25.780658 17079 raft_consensus.cc:697] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:25.781152 17023 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:25.781409 17079 consensus_queue.cc:237] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.781198 16846 raft_consensus.cc:515] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.786022 16846 leader_election.cc:290] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.788789 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:25.789352 16681 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.793898 16722 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:25.794312 16722 ts_tablet_manager.cc:1403] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.002s
I20260204 08:58:25.789551 17090 raft_consensus.cc:493] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.797461 17090 raft_consensus.cc:515] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.811721 16722 raft_consensus.cc:359] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.812459 16722 raft_consensus.cc:385] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:25.812709 16722 raft_consensus.cc:740] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:25.813324 16722 consensus_queue.cc:260] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:25.823426 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 58873.8us
I20260204 08:58:25.808928 17090 leader_election.cc:290] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:25.827373 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:25.840323 16986 leader_election.cc:290] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:25.880669 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:25.882320 16531 raft_consensus.cc:2468] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:25.882371 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82c2a342cc8c4de99746b3951b711b0c" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:25.892030 16572 leader_election.cc:304] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:25.883731 16677 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:25.892041 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:25.949918 17023 raft_consensus.cc:493] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:25.959743 16723 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:25.952770 16725 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:25.960850 16725 ts_tablet_manager.cc:1403] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.534s user 0.133s sys 0.197s
I20260204 08:58:25.961946 16723 ts_tablet_manager.cc:1403] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.382s user 0.020s sys 0.018s
I20260204 08:58:25.974328 16722 ts_tablet_manager.cc:1434] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.180s user 0.019s sys 0.026s
I20260204 08:58:25.975278 16722 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:25.951998 17026 raft_consensus.cc:2804] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:25.953677 16530 raft_consensus.cc:3060] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.945560 16681 raft_consensus.cc:2468] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
I20260204 08:58:25.951020 17023 raft_consensus.cc:515] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:25.978149 17026 raft_consensus.cc:493] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 08:58:25.986129 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 94188.2us
W20260204 08:58:25.987123 16498 leader_election.cc:343] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:25.990504 16572 leader_election.cc:343] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:25.989547 16429 catalog_manager.cc:5654] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:25.984433 17026 raft_consensus.cc:3060] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:25.993140 16429 catalog_manager.cc:5654] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:25.996057 16429 catalog_manager.cc:5654] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:25.999966 17099 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:26.000236 16725 raft_consensus.cc:359] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.000905 16725 raft_consensus.cc:385] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.001171 16725 raft_consensus.cc:740] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.001773 16725 consensus_queue.cc:260] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.001883 17099 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:26.005736 16725 ts_tablet_manager.cc:1434] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.045s user 0.005s sys 0.000s
I20260204 08:58:26.006335 16530 raft_consensus.cc:2468] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:26.006829 16723 raft_consensus.cc:359] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.007458 16723 raft_consensus.cc:385] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.010452 16723 raft_consensus.cc:740] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.013559 16723 consensus_queue.cc:260] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.016018 17023 leader_election.cc:290] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:26.020087 16526 raft_consensus.cc:3060] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:26.030426 16725 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:26.016980 17023 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260204 08:58:26.038491 16497 leader_election.cc:304] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:26.041152 16723 ts_tablet_manager.cc:1434] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.079s user 0.006s sys 0.000s
I20260204 08:58:26.046343 17096 raft_consensus.cc:2804] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:26.058054 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:26.069244 16430 catalog_manager.cc:5654] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 2, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:26.073132 16675 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:26.073839 16675 raft_consensus.cc:2468] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:26.056720 17096 raft_consensus.cc:697] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:26.085855 17096 consensus_queue.cc:237] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.069180 16722 tablet_bootstrap.cc:654] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.089345 16723 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
W20260204 08:58:26.263908 16646 leader_election.cc:343] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:26.261220 16725 tablet_bootstrap.cc:654] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.267534 16723 tablet_bootstrap.cc:654] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.284269 16677 raft_consensus.cc:1275] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260204 08:58:26.290004 16498 leader_election.cc:343] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:26.129966 17100 raft_consensus.cc:493] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:26.297788 16497 leader_election.cc:304] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:26.305877 16526 raft_consensus.cc:1275] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260204 08:58:26.089319 17026 raft_consensus.cc:515] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.306288 17112 raft_consensus.cc:2804] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:26.319790 17100 raft_consensus.cc:515] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.339243 17100 leader_election.cc:290] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
W20260204 08:58:26.340626 16497 consensus_peers.cc:597] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:58:26.342010 16498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 51149.4us
I20260204 08:58:26.321022 17112 raft_consensus.cc:493] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:26.322063 17102 consensus_queue.cc:1048] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260204 08:58:26.345005 17112 raft_consensus.cc:3060] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:26.355060 16672 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:26.355235 17098 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260204 08:58:26.353817 16844 consensus_queue.cc:1048] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260204 08:58:26.357331 16572 leader_election.cc:343] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:26.360582 17026 leader_election.cc:290] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:26.368989 16722 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:26.369478 16722 ts_tablet_manager.cc:1403] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.394s user 0.011s sys 0.011s
I20260204 08:58:26.344839 17105 consensus_queue.cc:1048] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260204 08:58:26.358198 17100 consensus_queue.cc:1048] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260204 08:58:26.374795 16527 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:26.343319 17078 consensus_queue.cc:1048] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260204 08:58:26.380281 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:26.388521 16525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:26.389225 16525 raft_consensus.cc:3060] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:26.393733 16722 raft_consensus.cc:359] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.396350 16722 raft_consensus.cc:385] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.396658 16722 raft_consensus.cc:740] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.402911 16722 consensus_queue.cc:260] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.383150 17022 raft_consensus.cc:493] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:58:26.404770 16572 leader_election.cc:343] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:26.412573 17111 raft_consensus.cc:493] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:26.413215 16722 ts_tablet_manager.cc:1434] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.043s user 0.006s sys 0.001s
I20260204 08:58:26.422260 16725 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:26.422820 16725 ts_tablet_manager.cc:1403] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.393s user 0.013s sys 0.014s
I20260204 08:58:26.413076 17111 raft_consensus.cc:515] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.425554 16734 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:26.433879 17111 leader_election.cc:290] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:26.460769 17112 raft_consensus.cc:515] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.462944 17112 leader_election.cc:290] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:26.412034 17022 raft_consensus.cc:515] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.469071 16723 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:26.469568 16723 ts_tablet_manager.cc:1403] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.380s user 0.028s sys 0.033s
I20260204 08:58:26.474107 16725 raft_consensus.cc:359] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.474838 16725 raft_consensus.cc:385] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.475082 16725 raft_consensus.cc:740] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.464267 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:26.481392 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82c2a342cc8c4de99746b3951b711b0c" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:26.475724 16725 consensus_queue.cc:260] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.535041 16722 tablet_bootstrap.cc:492] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:26.548995 16725 ts_tablet_manager.cc:1434] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.126s user 0.006s sys 0.000s
W20260204 08:58:26.549072 16498 leader_election.cc:343] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:58:26.551754 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:39491, user_credentials={real_user=slave}} blocked reactor thread for 149991us
I20260204 08:58:26.551838 16525 raft_consensus.cc:2468] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:26.486495 16527 raft_consensus.cc:2468] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:26.559806 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82c2a342cc8c4de99746b3951b711b0c" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:26.561841 16675 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:26.605682 17022 leader_election.cc:290] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:26.624586 16722 tablet_bootstrap.cc:654] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
W20260204 08:58:26.628798 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 44650us
I20260204 08:58:26.562402 16675 raft_consensus.cc:3060] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:26.664597 16734 raft_consensus.cc:493] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:26.665061 16734 raft_consensus.cc:515] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.714681 16675 raft_consensus.cc:2468] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 1.
W20260204 08:58:26.715577 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:39491, user_credentials={real_user=slave}} blocked reactor thread for 65979.5us
I20260204 08:58:26.718906 16734 leader_election.cc:290] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:26.725261 16723 raft_consensus.cc:359] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.725996 16723 raft_consensus.cc:385] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.726274 16723 raft_consensus.cc:740] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.726877 16723 consensus_queue.cc:260] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.747936 16723 ts_tablet_manager.cc:1434] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.278s user 0.006s sys 0.004s
I20260204 08:58:26.753744 16722 tablet_bootstrap.cc:492] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:26.754478 16722 ts_tablet_manager.cc:1403] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.220s user 0.004s sys 0.016s
I20260204 08:58:26.762126 16725 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:26.768780 16725 tablet_bootstrap.cc:654] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.780508 16725 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:26.780910 16725 ts_tablet_manager.cc:1403] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.002s
I20260204 08:58:26.783087 16725 raft_consensus.cc:359] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.783756 16725 raft_consensus.cc:385] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.784013 16725 raft_consensus.cc:740] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.784492 16725 consensus_queue.cc:260] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.786041 16725 ts_tablet_manager.cc:1434] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260204 08:58:26.786947 16725 tablet_bootstrap.cc:492] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:26.793033 16725 tablet_bootstrap.cc:654] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.797492 16725 tablet_bootstrap.cc:492] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:26.797911 16725 ts_tablet_manager.cc:1403] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260204 08:58:26.800861 16725 raft_consensus.cc:359] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.801415 16725 raft_consensus.cc:385] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.801669 16725 raft_consensus.cc:740] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.802250 16725 consensus_queue.cc:260] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.803586 16725 ts_tablet_manager.cc:1434] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260204 08:58:26.804312 16723 tablet_bootstrap.cc:492] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:26.804445 16725 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:26.809989 16725 tablet_bootstrap.cc:654] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.810479 17078 raft_consensus.cc:493] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:26.811005 17078 raft_consensus.cc:515] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.814134 17078 leader_election.cc:290] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:26.817775 16723 tablet_bootstrap.cc:654] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.821250 16725 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:26.821712 16725 ts_tablet_manager.cc:1403] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.008s
I20260204 08:58:26.824074 16725 raft_consensus.cc:359] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.824705 16725 raft_consensus.cc:385] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.824962 16725 raft_consensus.cc:740] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.825538 16725 consensus_queue.cc:260] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.827205 16725 ts_tablet_manager.cc:1434] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260204 08:58:26.828101 16725 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:26.830262 16723 tablet_bootstrap.cc:492] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:26.830969 16723 ts_tablet_manager.cc:1403] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.004s
I20260204 08:58:26.834208 16725 tablet_bootstrap.cc:654] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.833516 16723 raft_consensus.cc:359] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.838340 16723 raft_consensus.cc:385] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.838642 16723 raft_consensus.cc:740] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.839233 16723 consensus_queue.cc:260] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.841745 16723 ts_tablet_manager.cc:1434] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.010s user 0.003s sys 0.002s
I20260204 08:58:26.842543 16723 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:26.846760 16725 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:26.847210 16725 ts_tablet_manager.cc:1403] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.010s
W20260204 08:58:26.848610 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:58:26.849498 16725 raft_consensus.cc:359] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.849984 16725 raft_consensus.cc:385] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.850199 16723 tablet_bootstrap.cc:654] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.850226 16725 raft_consensus.cc:740] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.850926 16725 consensus_queue.cc:260] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.852756 16725 ts_tablet_manager.cc:1434] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260204 08:58:26.853570 16725 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: Bootstrap starting.
I20260204 08:58:26.858865 16725 tablet_bootstrap.cc:654] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.863801 16723 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:26.864240 16723 ts_tablet_manager.cc:1403] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.011s
I20260204 08:58:26.866252 16723 raft_consensus.cc:359] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.866874 16723 raft_consensus.cc:385] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.867053 16723 raft_consensus.cc:740] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.867738 16723 consensus_queue.cc:260] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.869640 16725 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: No bootstrap required, opened a new log
I20260204 08:58:26.869938 16723 ts_tablet_manager.cc:1434] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:58:26.870957 16723 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
I20260204 08:58:26.876854 16723 tablet_bootstrap.cc:654] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.869997 16725 ts_tablet_manager.cc:1403] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.009s
I20260204 08:58:26.880659 16725 raft_consensus.cc:359] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.881387 16725 raft_consensus.cc:385] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.881668 16725 raft_consensus.cc:740] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.882253 16725 consensus_queue.cc:260] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.883849 16723 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:26.883992 16725 ts_tablet_manager.cc:1434] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260204 08:58:26.884233 16723 ts_tablet_manager.cc:1403] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260204 08:58:26.886641 16723 raft_consensus.cc:359] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.887111 16723 raft_consensus.cc:385] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.887341 16723 raft_consensus.cc:740] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.887912 16723 consensus_queue.cc:260] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.890470 16723 ts_tablet_manager.cc:1434] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:58:26.891276 16723 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: Bootstrap starting.
W20260204 08:58:26.895404 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:39491, user_credentials={real_user=slave}} blocked reactor thread for 336876us
I20260204 08:58:26.895629 16723 tablet_bootstrap.cc:654] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:26.897847 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:26.898456 16678 raft_consensus.cc:2468] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:26.908232 16723 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: No bootstrap required, opened a new log
I20260204 08:58:26.908778 16723 ts_tablet_manager.cc:1403] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.004s
I20260204 08:58:26.910009 16598 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:26.910665 16598 raft_consensus.cc:2468] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 0.
I20260204 08:58:26.910739 16723 raft_consensus.cc:359] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.911273 16723 raft_consensus.cc:385] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:26.911520 16723 raft_consensus.cc:740] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Initialized, Role: FOLLOWER
I20260204 08:58:26.912237 16723 consensus_queue.cc:260] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.914222 16723 ts_tablet_manager.cc:1434] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260204 08:58:26.916285 17079 raft_consensus.cc:493] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35380a227e2c4fa4a063d4fd67c30b53)
I20260204 08:58:26.916798 17079 raft_consensus.cc:515] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.918320 17079 leader_election.cc:290] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:26.925172 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:26.934103 16607 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35fde83161df49e09eb28ee05a4ad35f" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:26.953958 16601 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2e4ca7bedb84f7ba570333f98fb5de5" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:26.925755 16602 raft_consensus.cc:2468] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:26.981086 17024 raft_consensus.cc:493] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35380a227e2c4fa4a063d4fd67c30b53)
I20260204 08:58:26.981681 17024 raft_consensus.cc:515] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:26.983788 17024 leader_election.cc:290] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.006690 17035 raft_consensus.cc:493] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:27.007217 17035 raft_consensus.cc:515] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.009269 17035 leader_election.cc:290] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:27.024068 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4fba286cf394487ab1cf2b45d55835b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.024902 16604 raft_consensus.cc:2468] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:27.035841 16647 leader_election.cc:304] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:27.039438 17117 raft_consensus.cc:493] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:27.040055 17117 raft_consensus.cc:515] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.042004 17117 leader_election.cc:290] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.043183 16734 raft_consensus.cc:2804] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:27.043581 16734 raft_consensus.cc:493] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:27.043895 16734 raft_consensus.cc:3060] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.050719 16722 raft_consensus.cc:359] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.054226 16647 leader_election.cc:304] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:27.055027 17039 raft_consensus.cc:2804] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:27.051457 16722 raft_consensus.cc:385] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:27.055384 17039 raft_consensus.cc:493] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:27.055604 16722 raft_consensus.cc:740] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:27.056032 16675 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "326778f65c8845f5bc8e4a236d093bfe" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.056914 16722 consensus_queue.cc:260] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.057601 17102 raft_consensus.cc:493] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:27.058435 17102 raft_consensus.cc:515] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.060163 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2372d97d9af497ea9e6782d61032982" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.055801 17039 raft_consensus.cc:3060] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.060786 16679 raft_consensus.cc:2468] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:27.060252 17102 leader_election.cc:290] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.062171 16427 catalog_manager.cc:5654] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
W20260204 08:58:27.063391 16498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 155485us
I20260204 08:58:27.064232 16572 leader_election.cc:304] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:27.064906 17102 raft_consensus.cc:2804] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:27.065349 17102 raft_consensus.cc:697] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:27.066092 17102 consensus_queue.cc:237] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.071111 16677 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8689b3435b4f43a1b5a8c5af26f23c2c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.072700 16677 raft_consensus.cc:2468] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:27.050774 16734 raft_consensus.cc:515] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.077389 16734 leader_election.cc:290] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:27.078172 16429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45056 (request call id 111) took 1198 ms. Trace:
I20260204 08:58:27.071111 17039 raft_consensus.cc:515] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.080732 16599 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.081519 17039 leader_election.cc:290] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:27.082355 16430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45054 (request call id 109) took 1095 ms. Trace:
I20260204 08:58:27.082707 16430 rpcz_store.cc:276] 0204 08:58:25.987156 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:58:25.987300 (+ 144us) service_pool.cc:225] Handling call
0204 08:58:27.082291 (+1094991us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 08:58:26.449715 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 08:58:26.450245 (+ 530us) write_op.cc:432] Acquiring schema lock in shared mode
0204 08:58:26.450274 (+ 29us) write_op.cc:435] Acquired schema lock
0204 08:58:26.450291 (+ 17us) tablet.cc:660] Decoding operations
0204 08:58:26.450610 (+ 319us) write_op.cc:620] Acquiring the partition lock for write op
0204 08:58:26.450657 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0204 08:58:26.450684 (+ 27us) tablet.cc:683] Acquiring locks for 1 operations
0204 08:58:26.450850 (+ 166us) tablet.cc:699] Row locks acquired
0204 08:58:26.450865 (+ 15us) write_op.cc:260] PREPARE: finished
0204 08:58:26.450992 (+ 127us) write_op.cc:270] Start()
0204 08:58:26.465976 (+ 14984us) write_op.cc:276] Timestamp: P: 1770195506450951 usec, L: 0
0204 08:58:26.465999 (+ 23us) op_driver.cc:348] REPLICATION: starting
0204 08:58:26.510610 (+ 44611us) log.cc:844] Serialized 537 byte log entry
0204 08:58:26.746039 (+235429us) op_driver.cc:464] REPLICATION: finished
0204 08:58:26.746360 (+ 321us) write_op.cc:301] APPLY: starting
0204 08:58:26.746425 (+ 65us) tablet.cc:1365] starting BulkCheckPresence
0204 08:58:26.746758 (+ 333us) tablet.cc:1368] finished BulkCheckPresence
0204 08:58:26.746866 (+ 108us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 08:58:26.747042 (+ 176us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 08:58:26.747372 (+ 330us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0204 08:58:26.747402 (+ 30us) write_op.cc:312] APPLY: finished
0204 08:58:26.747536 (+ 134us) log.cc:844] Serialized 22 byte log entry
0204 08:58:26.747688 (+ 152us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:58:26.747757 (+ 69us) write_op.cc:454] Released schema lock
0204 08:58:26.747789 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0204 08:58:26.748016 (+ 227us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:58:26.748039 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10489,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":130,"apply.run_cpu_time_us":1232,"apply.run_wall_time_us":1646,"num_ops":1,"prepare.queue_time_us":375544,"prepare.run_cpu_time_us":2695,"prepare.run_wall_time_us":78806,"replication_time_us":278510}]]}
I20260204 08:58:27.078567 16429 rpcz_store.cc:276] 0204 08:58:25.879889 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:58:25.880846 (+ 957us) service_pool.cc:225] Handling call
0204 08:58:27.078083 (+1197237us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 08:58:26.331483 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 08:58:26.400666 (+ 69183us) write_op.cc:432] Acquiring schema lock in shared mode
0204 08:58:26.403208 (+ 2542us) write_op.cc:435] Acquired schema lock
0204 08:58:26.405569 (+ 2361us) tablet.cc:660] Decoding operations
0204 08:58:26.447945 (+ 42376us) write_op.cc:620] Acquiring the partition lock for write op
0204 08:58:26.448021 (+ 76us) write_op.cc:641] Partition lock acquired for write op
0204 08:58:26.448051 (+ 30us) tablet.cc:683] Acquiring locks for 3 operations
0204 08:58:26.448380 (+ 329us) tablet.cc:699] Row locks acquired
0204 08:58:26.448399 (+ 19us) write_op.cc:260] PREPARE: finished
0204 08:58:26.448552 (+ 153us) write_op.cc:270] Start()
0204 08:58:26.448662 (+ 110us) write_op.cc:276] Timestamp: P: 1770195506448498 usec, L: 0
0204 08:58:26.448683 (+ 21us) op_driver.cc:348] REPLICATION: starting
0204 08:58:26.449312 (+ 629us) log.cc:844] Serialized 1307 byte log entry
0204 08:58:26.728165 (+278853us) op_driver.cc:464] REPLICATION: finished
0204 08:58:26.738844 (+ 10679us) write_op.cc:301] APPLY: starting
0204 08:58:26.738921 (+ 77us) tablet.cc:1365] starting BulkCheckPresence
0204 08:58:26.740170 (+ 1249us) tablet.cc:1368] finished BulkCheckPresence
0204 08:58:26.740310 (+ 140us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 08:58:26.741249 (+ 939us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 08:58:26.741418 (+ 169us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0204 08:58:26.741465 (+ 47us) write_op.cc:312] APPLY: finished
0204 08:58:26.741674 (+ 209us) log.cc:844] Serialized 34 byte log entry
0204 08:58:26.743203 (+ 1529us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:58:26.743290 (+ 87us) write_op.cc:454] Released schema lock
0204 08:58:26.743330 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":55224,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":10457,"apply.run_cpu_time_us":2106,"apply.run_wall_time_us":4797,"num_ops":3,"prepare.queue_time_us":315749,"prepare.run_cpu_time_us":3723,"prepare.run_wall_time_us":125721,"replication_time_us":279331,"thread_start_us":60062,"threads_started":2}]]}
I20260204 08:58:27.090364 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:27.095086 16604 raft_consensus.cc:3060] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.100739 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4fba286cf394487ab1cf2b45d55835b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:27.101400 16602 raft_consensus.cc:3060] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.107879 16602 raft_consensus.cc:2468] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:27.111100 16647 leader_election.cc:304] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:27.111954 17039 raft_consensus.cc:2804] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:27.112458 17039 raft_consensus.cc:697] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:27.113348 17039 consensus_queue.cc:237] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.121877 16572 leader_election.cc:304] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:27.123139 16497 leader_election.cc:304] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.125072 16497 leader_election.cc:304] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.125891 16722 ts_tablet_manager.cc:1434] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.371s user 0.008s sys 0.000s
I20260204 08:58:27.126835 16722 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:27.127849 17022 raft_consensus.cc:2749] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:27.131628 17113 raft_consensus.cc:2804] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:27.132169 17113 raft_consensus.cc:697] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:27.132985 17113 consensus_queue.cc:237] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.134661 16722 tablet_bootstrap.cc:654] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:27.135488 16497 leader_election.cc:304] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:27.140717 16604 raft_consensus.cc:2468] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:27.141337 17092 raft_consensus.cc:2764] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260204 08:58:27.143205 17149 raft_consensus.cc:2804] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:27.143621 17149 raft_consensus.cc:493] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:27.143980 17149 raft_consensus.cc:3060] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.145998 17091 raft_consensus.cc:493] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35380a227e2c4fa4a063d4fd67c30b53)
I20260204 08:58:27.153014 17091 raft_consensus.cc:515] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.145095 16976 raft_consensus.cc:493] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:58:27.197814 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:39491, user_credentials={real_user=slave}} blocked reactor thread for 53086us
I20260204 08:58:27.461802 16722 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:27.266218 16734 raft_consensus.cc:493] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35380a227e2c4fa4a063d4fd67c30b53)
W20260204 08:58:27.498224 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:39491, user_credentials={real_user=slave}} blocked reactor thread for 353574us
I20260204 08:58:27.498953 16722 ts_tablet_manager.cc:1403] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.372s user 0.019s sys 0.013s
I20260204 08:58:27.202096 16647 leader_election.cc:304] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
W20260204 08:58:27.502363 16647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 300343us
I20260204 08:58:27.502560 16734 raft_consensus.cc:515] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.502935 16846 raft_consensus.cc:493] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86e16045049f4f87a94336b5d2262328)
I20260204 08:58:27.503469 16846 raft_consensus.cc:515] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.204278 17079 raft_consensus.cc:493] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:27.509209 16572 leader_election.cc:304] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:27.509687 16986 raft_consensus.cc:2804] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:27.462059 17035 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260204 08:58:27.512080 16846 leader_election.cc:290] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.204107 17091 leader_election.cc:290] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.521363 17100 raft_consensus.cc:2804] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:58:27.521749 17100 raft_consensus.cc:493] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:27.504343 16796 raft_consensus.cc:493] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86e16045049f4f87a94336b5d2262328)
I20260204 08:58:27.522075 17100 raft_consensus.cc:3060] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.522379 16796 raft_consensus.cc:515] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } }
I20260204 08:58:27.524197 16796 leader_election.cc:290] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:27.206444 17039 raft_consensus.cc:493] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35380a227e2c4fa4a063d4fd67c30b53)
I20260204 08:58:27.524981 17039 raft_consensus.cc:515] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.526808 17039 leader_election.cc:290] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:27.289310 17150 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.242s
I20260204 08:58:27.516732 17079 raft_consensus.cc:515] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.530159 17079 leader_election.cc:290] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:27.266490 16676 raft_consensus.cc:3060] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.197996 16976 raft_consensus.cc:515] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.547873 16976 leader_election.cc:290] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.504086 17096 raft_consensus.cc:493] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86e16045049f4f87a94336b5d2262328)
I20260204 08:58:27.519904 16734 leader_election.cc:290] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:27.520414 16572 leader_election.cc:304] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
W20260204 08:58:27.566388 16572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:39491, user_credentials={real_user=slave}} blocked reactor thread for 46049.5us
I20260204 08:58:27.581825 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.583616 16532 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.586474 16846 raft_consensus.cc:493] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86e16045049f4f87a94336b5d2262328)
I20260204 08:58:27.587502 16722 raft_consensus.cc:359] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.588196 16722 raft_consensus.cc:385] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:27.587056 16846 raft_consensus.cc:515] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.588496 16722 raft_consensus.cc:740] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:27.589092 16722 consensus_queue.cc:260] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.593412 16846 leader_election.cc:290] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.582703 17092 raft_consensus.cc:2804] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260204 08:58:27.597268 16646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 89922.2us
I20260204 08:58:27.586002 16986 raft_consensus.cc:697] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:27.602100 16722 ts_tablet_manager.cc:1434] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.103s user 0.006s sys 0.000s
I20260204 08:58:27.603112 16722 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53: Bootstrap starting.
I20260204 08:58:27.604717 17100 raft_consensus.cc:515] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.606534 17100 leader_election.cc:290] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.582931 17096 raft_consensus.cc:515] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.597771 17099 raft_consensus.cc:493] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:27.594561 17150 raft_consensus.cc:493] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86e16045049f4f87a94336b5d2262328)
I20260204 08:58:27.597720 17092 raft_consensus.cc:493] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:58:27.597954 16796 raft_consensus.cc:493] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:27.625615 17092 raft_consensus.cc:3060] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.609318 16986 consensus_queue.cc:237] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.599974 17149 raft_consensus.cc:515] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.626860 17096 leader_election.cc:290] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.627676 16523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "326778f65c8845f5bc8e4a236d093bfe" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.626093 17099 raft_consensus.cc:515] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.627508 17150 raft_consensus.cc:515] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.625738 16796 raft_consensus.cc:515] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.630873 16527 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35fde83161df49e09eb28ee05a4ad35f" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.639714 17150 leader_election.cc:290] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.640190 17099 leader_election.cc:290] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.641008 16524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.641453 16527 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4fba286cf394487ab1cf2b45d55835b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.641796 16524 raft_consensus.cc:2393] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86e16045049f4f87a94336b5d2262328 in current term 1: Already voted for candidate 35380a227e2c4fa4a063d4fd67c30b53 in this term.
I20260204 08:58:27.642040 16527 raft_consensus.cc:2468] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 0.
I20260204 08:58:27.642791 16524 raft_consensus.cc:3060] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.642670 16528 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2e4ca7bedb84f7ba570333f98fb5de5" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.649964 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2372d97d9af497ea9e6782d61032982" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.638319 17149 leader_election.cc:290] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.651053 16527 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:27.652165 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2372d97d9af497ea9e6782d61032982" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:27.652385 16531 raft_consensus.cc:2468] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 0.
I20260204 08:58:27.652779 16678 raft_consensus.cc:3060] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.651820 16527 raft_consensus.cc:2393] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86e16045049f4f87a94336b5d2262328 in current term 1: Already voted for candidate 35380a227e2c4fa4a063d4fd67c30b53 in this term.
I20260204 08:58:27.655699 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.650967 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.660548 16722 tablet_bootstrap.cc:654] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53: Neither blocks nor log segments found. Creating new log.
I20260204 08:58:27.650238 16796 leader_election.cc:290] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
W20260204 08:58:27.664098 15380 debug-util.cc:398] Leaking SignalData structure 0x7b080000f8c0 after lost signal to thread 16497
I20260204 08:58:27.662246 16572 leader_election.cc:304] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:27.652120 17092 raft_consensus.cc:515] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.668396 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2372d97d9af497ea9e6782d61032982" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:27.670614 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8689b3435b4f43a1b5a8c5af26f23c2c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
W20260204 08:58:27.683231 16572 leader_election.cc:343] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:27.680317 16674 raft_consensus.cc:2393] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f959652a42f34a81aca5da9faec0a7a3 in current term 1: Already voted for candidate 35380a227e2c4fa4a063d4fd67c30b53 in this term.
I20260204 08:58:27.680647 16531 raft_consensus.cc:3060] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.682123 16529 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4fba286cf394487ab1cf2b45d55835b" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:27.686223 16680 raft_consensus.cc:3060] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.676389 17117 raft_consensus.cc:2749] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.678761 16523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.689159 16529 raft_consensus.cc:3060] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.694808 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.695396 16679 raft_consensus.cc:2468] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:27.713572 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.716553 16672 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.716810 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "147ea8d1b63e4e9e8f084676f3f0ea12" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.717283 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:27.717864 16604 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.718093 16603 raft_consensus.cc:2393] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35380a227e2c4fa4a063d4fd67c30b53 in current term 1: Already voted for candidate 86e16045049f4f87a94336b5d2262328 in this term.
I20260204 08:58:27.719897 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.720024 16672 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:27.720585 16681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.721066 16672 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "147ea8d1b63e4e9e8f084676f3f0ea12" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.721737 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.726028 16601 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.730177 16527 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.730933 16530 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.731302 16527 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53" is_pre_election: true
I20260204 08:58:27.732020 16527 raft_consensus.cc:2393] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86e16045049f4f87a94336b5d2262328 in current term 1: Already voted for candidate f959652a42f34a81aca5da9faec0a7a3 in this term.
I20260204 08:58:27.732333 16677 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a3887aa0f64b1a8d49dc7e0e061459" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.736265 16646 leader_election.cc:304] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.757622 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "569b49ee7fc94d7bab7861620dbccfed" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.764159 16646 leader_election.cc:304] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.764165 16572 leader_election.cc:304] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:27.759017 17035 raft_consensus.cc:2749] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:27.766351 17079 raft_consensus.cc:2749] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.766409 17090 raft_consensus.cc:2749] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260204 08:58:27.767292 17164 log.cc:927] Time spent T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: Append to log took a long time: real 0.087s user 0.001s sys 0.000s
I20260204 08:58:27.770157 17092 leader_election.cc:290] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:27.770988 16529 raft_consensus.cc:2468] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 1.
I20260204 08:58:27.772996 16678 raft_consensus.cc:2468] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:27.764715 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:27.768649 16523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8689b3435b4f43a1b5a8c5af26f23c2c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:27.784319 16531 raft_consensus.cc:2468] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:27.798739 16497 leader_election.cc:304] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.801751 16796 raft_consensus.cc:2749] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.801908 16846 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:27.804780 16572 leader_election.cc:304] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328
I20260204 08:58:27.807209 16572 leader_election.cc:304] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:27.812173 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.807081 17092 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260204 08:58:27.806660 17090 raft_consensus.cc:3060] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.815294 16572 leader_election.cc:304] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:27.825942 17090 raft_consensus.cc:2749] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:27.832195 17100 raft_consensus.cc:2804] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:27.837126 17100 raft_consensus.cc:697] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:27.815491 17035 consensus_queue.cc:1048] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260204 08:58:27.831882 16976 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260204 08:58:27.843849 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.837947 17100 consensus_queue.cc:237] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.852869 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.853474 17035 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:27.860241 17161 raft_consensus.cc:2804] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260204 08:58:27.862180 16572 leader_election.cc:343] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:58:27.870644 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8689b3435b4f43a1b5a8c5af26f23c2c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:27.871237 16673 raft_consensus.cc:3060] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:27.878000 16647 leader_election.cc:304] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.879251 16986 raft_consensus.cc:2749] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.872241 16498 leader_election.cc:304] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.882864 16796 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:27.879295 16647 leader_election.cc:304] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.886485 16498 leader_election.cc:304] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.887583 16498 leader_election.cc:304] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.889094 16796 raft_consensus.cc:2749] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260204 08:58:27.889855 16796 raft_consensus.cc:2749] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.891711 16498 leader_election.cc:304] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.893667 16498 leader_election.cc:304] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.900609 16498 leader_election.cc:304] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.903293 16647 leader_election.cc:304] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86e16045049f4f87a94336b5d2262328; no voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:27.908730 16722 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53: No bootstrap required, opened a new log
I20260204 08:58:27.894994 17035 raft_consensus.cc:2749] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.909204 16722 ts_tablet_manager.cc:1403] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53: Time spent bootstrapping tablet: real 0.306s user 0.011s sys 0.026s
I20260204 08:58:27.890707 17150 raft_consensus.cc:2749] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.894986 17152 raft_consensus.cc:2749] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.905975 17122 raft_consensus.cc:2749] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.903615 17096 raft_consensus.cc:2749] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:27.941666 17152 raft_consensus.cc:493] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86e16045049f4f87a94336b5d2262328)
I20260204 08:58:27.951488 17152 raft_consensus.cc:515] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.943423 17122 raft_consensus.cc:493] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86e16045049f4f87a94336b5d2262328)
I20260204 08:58:27.952950 17122 raft_consensus.cc:515] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:27.953482 17152 leader_election.cc:290] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
W20260204 08:58:27.967218 16498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 63645.7us
I20260204 08:58:27.971990 17161 raft_consensus.cc:493] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35380a227e2c4fa4a063d4fd67c30b53)
I20260204 08:58:27.972525 17161 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:27.973738 17097 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260204 08:58:27.969054 16628 debug-util.cc:398] Leaking SignalData structure 0x7b08000d86c0 after lost signal to thread 15378
W20260204 08:58:27.979211 16628 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6ee0 after lost signal to thread 16464
W20260204 08:58:27.980268 16628 debug-util.cc:398] Leaking SignalData structure 0x7b080026bf40 after lost signal to thread 16556
W20260204 08:58:27.980540 16628 debug-util.cc:398] Leaking SignalData structure 0x7b080026bf20 after lost signal to thread 16557
W20260204 08:58:27.981408 16628 debug-util.cc:398] Leaking SignalData structure 0x7b0800255160 after lost signal to thread 16631
W20260204 08:58:27.982316 16628 debug-util.cc:398] Leaking SignalData structure 0x7b0800052580 after lost signal to thread 16705
I20260204 08:58:27.977035 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:27.988797 17122 leader_election.cc:290] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:28.001734 16679 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457a55a8c34648f6ae2a009fcb9fd749" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:28.003099 16676 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:28.005518 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457a55a8c34648f6ae2a009fcb9fd749" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:28.006213 16427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45048 (request call id 108) took 1961 ms. Trace:
W20260204 08:58:28.008314 16478 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:58:27.995924 17152 raft_consensus.cc:493] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86e16045049f4f87a94336b5d2262328)
I20260204 08:58:28.016755 16497 leader_election.cc:304] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:28.009194 17160 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260204 08:58:28.021483 17152 raft_consensus.cc:515] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:28.029471 17152 leader_election.cc:290] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:28.006579 16427 rpcz_store.cc:276] 0204 08:58:26.050464 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:58:26.053072 (+ 2608us) service_pool.cc:225] Handling call
0204 08:58:28.006136 (+1953064us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 08:58:27.453733 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 08:58:27.454266 (+ 533us) write_op.cc:432] Acquiring schema lock in shared mode
0204 08:58:27.454305 (+ 39us) write_op.cc:435] Acquired schema lock
0204 08:58:27.454322 (+ 17us) tablet.cc:660] Decoding operations
0204 08:58:27.454630 (+ 308us) write_op.cc:620] Acquiring the partition lock for write op
0204 08:58:27.454702 (+ 72us) write_op.cc:641] Partition lock acquired for write op
0204 08:58:27.454733 (+ 31us) tablet.cc:683] Acquiring locks for 1 operations
0204 08:58:27.454906 (+ 173us) tablet.cc:699] Row locks acquired
0204 08:58:27.454925 (+ 19us) write_op.cc:260] PREPARE: finished
0204 08:58:27.455053 (+ 128us) write_op.cc:270] Start()
0204 08:58:27.455157 (+ 104us) write_op.cc:276] Timestamp: P: 1770195507455010 usec, L: 0
0204 08:58:27.455176 (+ 19us) op_driver.cc:348] REPLICATION: starting
0204 08:58:27.582060 (+126884us) log.cc:844] Serialized 537 byte log entry
0204 08:58:27.624549 (+ 42489us) op_driver.cc:464] REPLICATION: finished
0204 08:58:27.672567 (+ 48018us) write_op.cc:301] APPLY: starting
0204 08:58:27.673645 (+ 1078us) tablet.cc:1365] starting BulkCheckPresence
0204 08:58:27.678004 (+ 4359us) tablet.cc:1368] finished BulkCheckPresence
0204 08:58:27.685713 (+ 7709us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 08:58:27.688929 (+ 3216us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 08:58:27.698995 (+ 10066us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0204 08:58:27.699742 (+ 747us) write_op.cc:312] APPLY: finished
0204 08:58:27.762492 (+ 62750us) log.cc:844] Serialized 22 byte log entry
0204 08:58:27.775939 (+ 13447us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:58:27.776017 (+ 78us) write_op.cc:454] Released schema lock
0204 08:58:27.776058 (+ 41us) write_op.cc:341] FINISH: Updating metrics
0204 08:58:27.811096 (+ 35038us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:58:27.812309 (+ 1213us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":137004,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":37707,"apply.run_cpu_time_us":1856,"apply.run_wall_time_us":130074,"num_ops":1,"prepare.queue_time_us":384542,"prepare.run_cpu_time_us":2622,"prepare.run_wall_time_us":133138,"replication_time_us":169242,"thread_start_us":84861,"threads_started":2}]]}
I20260204 08:58:28.032382 16498 leader_election.cc:304] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
W20260204 08:58:28.032971 16647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 122257us
I20260204 08:58:28.033766 17186 raft_consensus.cc:2749] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:28.034193 16675 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:28.018275 16673 raft_consensus.cc:2468] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 1.
I20260204 08:58:28.046859 16572 leader_election.cc:304] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters: 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:28.046864 16602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:28.048113 17183 raft_consensus.cc:2749] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:28.048859 16498 leader_election.cc:304] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:28.052661 16986 raft_consensus.cc:2749] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:28.060490 17159 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260204 08:58:28.054462 17183 raft_consensus.cc:2749] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:58:28.054018 17091 raft_consensus.cc:2804] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:58:28.069398 17161 raft_consensus.cc:515] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:28.070470 16603 raft_consensus.cc:1240] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Rejecting Update request from peer 35380a227e2c4fa4a063d4fd67c30b53 for earlier term 1. Current term is 2. Ops: []
I20260204 08:58:28.071894 17091 raft_consensus.cc:697] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:28.072767 17091 consensus_queue.cc:237] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:28.079470 17097 consensus_queue.cc:1059] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260204 08:58:28.081693 17097 raft_consensus.cc:3055] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:28.082006 17097 raft_consensus.cc:740] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:28.082717 17097 consensus_queue.cc:260] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:28.083408 16722 raft_consensus.cc:359] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:28.087873 16722 raft_consensus.cc:385] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:58:28.088191 16722 raft_consensus.cc:740] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Initialized, Role: FOLLOWER
I20260204 08:58:28.090492 16722 consensus_queue.cc:260] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:58:28.146857 17189 log.cc:927] Time spent T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260204 08:58:28.144223 17161 leader_election.cc:290] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:28.151971 17097 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:28.146134 16430 catalog_manager.cc:5654] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:28.154762 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:28.148694 16524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:28.167614 16722 ts_tablet_manager.cc:1434] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53: Time spent starting tablet: real 0.257s user 0.009s sys 0.002s
I20260204 08:58:28.187520 17186 raft_consensus.cc:493] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:58:28.193321 17186 raft_consensus.cc:515] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:28.204738 17186 leader_election.cc:290] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:28.208199 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8689b3435b4f43a1b5a8c5af26f23c2c" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e16045049f4f87a94336b5d2262328" is_pre_election: true
I20260204 08:58:28.209022 16673 raft_consensus.cc:2393] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35380a227e2c4fa4a063d4fd67c30b53 in current term 1: Already voted for candidate f959652a42f34a81aca5da9faec0a7a3 in this term.
I20260204 08:58:28.218819 16524 raft_consensus.cc:2468] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:28.221030 16599 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8689b3435b4f43a1b5a8c5af26f23c2c" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f959652a42f34a81aca5da9faec0a7a3" is_pre_election: true
I20260204 08:58:28.223909 17180 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260204 08:58:28.239205 16734 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:28.239598 16498 leader_election.cc:304] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53; no voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:28.242368 17183 raft_consensus.cc:3060] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:58:28.249588 17183 raft_consensus.cc:2749] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:58:28.259323 16572 leader_election.cc:304] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters: 86e16045049f4f87a94336b5d2262328
I20260204 08:58:28.260211 17175 raft_consensus.cc:2804] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:28.260879 17175 raft_consensus.cc:697] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:28.261798 16429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45056 (request call id 112) took 1150 ms. Trace:
I20260204 08:58:28.262243 16429 rpcz_store.cc:276] 0204 08:58:27.111640 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:58:27.111809 (+ 169us) service_pool.cc:225] Handling call
0204 08:58:28.261725 (+1149916us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5028,"reported_tablets":14}
I20260204 08:58:28.261866 17175 consensus_queue.cc:237] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:28.324577 16429 catalog_manager.cc:5654] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:28.326196 16429 catalog_manager.cc:5654] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:28.329977 16429 catalog_manager.cc:5654] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } }
I20260204 08:58:28.331235 16429 catalog_manager.cc:5654] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } }
I20260204 08:58:28.362142 16430 catalog_manager.cc:5654] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:28.363960 16430 catalog_manager.cc:5654] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:28.365634 16430 catalog_manager.cc:5654] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:28.392629 17175 consensus_queue.cc:1048] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:28.403105 17161 consensus_queue.cc:1048] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:28.533260 17092 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:28.545186 17161 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:58:28.837394 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260204 08:58:28.848961 16524 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:28.850696 17161 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:28.855324 16673 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:28.891237 16673 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:28.918002 17092 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260204 08:58:28.981087 17207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:28.986032 17208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:58:28.996619 17211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:58:28.998438 15375 server_base.cc:1060] running on GCE node
I20260204 08:58:29.000072 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:58:29.000375 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:58:29.000576 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195509000560 us; error 0 us; skew 500 ppm
I20260204 08:58:29.001312 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:58:29.014050 15375 webserver.cc:492] Webserver started at http://127.15.3.196:46235/ using document root <none> and password file <none>
I20260204 08:58:29.014772 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:58:29.015056 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:58:29.015451 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:58:29.017514 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-3-root/instance:
uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
format_stamp: "Formatted at 2026-02-04 08:58:29 on dist-test-slave-3tf0"
I20260204 08:58:29.030699 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.012s user 0.005s sys 0.008s
I20260204 08:58:29.069662 17215 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:29.070986 15375 fs_manager.cc:730] Time spent opening block manager: real 0.037s user 0.002s sys 0.033s
I20260204 08:58:29.071373 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-3-root
uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
format_stamp: "Formatted at 2026-02-04 08:58:29 on dist-test-slave-3tf0"
I20260204 08:58:29.071794 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:58:29.114403 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:58:29.116195 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:58:29.128118 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:58:29.140588 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:58:29.140909 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:29.141208 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:58:29.141426 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:58:29.251595 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.196:33281
I20260204 08:58:29.251979 17277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.196:33281 every 8 connection(s)
I20260204 08:58:29.267316 15375 auto_leader_rebalancer-test.cc:417] add a tserver: 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:29.286507 17278 heartbeater.cc:344] Connected to a master server at 127.15.3.254:45355
I20260204 08:58:29.286919 17278 heartbeater.cc:461] Registering TS with master...
I20260204 08:58:29.287699 17278 heartbeater.cc:507] Master 127.15.3.254:45355 requested a full tablet report, sending...
I20260204 08:58:29.289678 16430 ts_manager.cc:194] Registered new tserver with Master: 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:58:29.291142 16430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34340
I20260204 08:58:30.255059 16599 consensus_queue.cc:237] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:30.264983 16673 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:30.265010 16531 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:30.266727 17161 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:30.268640 17288 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:30.280644 17288 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.288364 16531 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.293684 17278 heartbeater.cc:499] Master 127.15.3.254:45355 was elected leader, sending a full tablet report...
I20260204 08:58:30.297650 16674 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.316849 16429 catalog_manager.cc:5654] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
W20260204 08:58:30.323585 16573 consensus_peers.cc:597] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0b534820859442b49b61eb04ce7e2363. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:30.358793 16531 consensus_queue.cc:237] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:30.368072 16674 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:30.381366 17205 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:30.393527 16601 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:30.397995 17183 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260204 08:58:30.399555 16498 consensus_peers.cc:597] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61ec06ad82864d3a91228c325fd1af2d. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:30.401916 17183 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.403321 16678 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.423244 16529 consensus_queue.cc:237] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:30.423631 16601 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.428038 16430 catalog_manager.cc:5654] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.459949 16678 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:30.460459 16603 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:30.461395 16498 consensus_peers.cc:597] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 810a9a6b2d154b6d9a7b8c4d2db5f692. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:30.461486 17285 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:30.464107 17285 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:30.478852 17183 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.482402 16674 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.494284 16603 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.501437 16430 catalog_manager.cc:5654] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.542124 16674 consensus_queue.cc:237] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:30.548797 16529 raft_consensus.cc:1275] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:30.550391 16734 consensus_queue.cc:1048] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:30.556133 16603 raft_consensus.cc:1275] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:30.563733 16734 consensus_queue.cc:1048] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:58:30.570943 16647 consensus_peers.cc:597] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 457a55a8c34648f6ae2a009fcb9fd749. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:30.574815 17079 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.577071 16529 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.602108 16600 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:30.599772 16430 catalog_manager.cc:5654] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:30.832727 17312 ts_tablet_manager.cc:933] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:30.834522 17312 tablet_copy_client.cc:323] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:30.858568 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 0b534820859442b49b61eb04ce7e2363 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:30.859113 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 0b534820859442b49b61eb04ce7e2363 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-0b534820859442b49b61eb04ce7e2363
I20260204 08:58:30.865599 16617 tablet_copy_source_session.cc:215] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:30.869592 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b534820859442b49b61eb04ce7e2363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:30.886945 17312 tablet_copy_client.cc:806] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:30.887742 17312 tablet_copy_client.cc:670] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:30.896221 17312 tablet_copy_client.cc:538] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:30.902926 17316 ts_tablet_manager.cc:933] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:30.906131 17312 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:30.915625 17316 tablet_copy_client.cc:323] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:30.932574 17312 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:30.934085 17312 tablet_bootstrap.cc:492] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:30.934794 17312 ts_tablet_manager.cc:1403] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.029s user 0.017s sys 0.009s
I20260204 08:58:30.938783 17312 raft_consensus.cc:359] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:30.940450 17312 raft_consensus.cc:740] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:30.941043 17312 consensus_queue.cc:260] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:30.984493 17321 ts_tablet_manager.cc:933] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:31.002061 17321 tablet_copy_client.cc:323] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:31.005231 17312 ts_tablet_manager.cc:1434] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.070s user 0.032s sys 0.028s
I20260204 08:58:31.011801 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 61ec06ad82864d3a91228c325fd1af2d from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:31.011958 16542 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:31.012423 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 61ec06ad82864d3a91228c325fd1af2d from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-61ec06ad82864d3a91228c325fd1af2d
I20260204 08:58:31.015087 16542 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-810a9a6b2d154b6d9a7b8c4d2db5f692
I20260204 08:58:31.021186 16541 tablet_copy_source_session.cc:215] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:31.023834 16542 tablet_copy_source_session.cc:215] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:31.024585 17321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ec06ad82864d3a91228c325fd1af2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:31.031816 17316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:31.034412 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-0b534820859442b49b61eb04ce7e2363 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:31.034940 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-0b534820859442b49b61eb04ce7e2363 on tablet 0b534820859442b49b61eb04ce7e2363 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:31.056782 17316 tablet_copy_client.cc:806] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:31.060258 17316 tablet_copy_client.cc:670] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:31.062912 17321 tablet_copy_client.cc:806] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:31.063526 17321 tablet_copy_client.cc:670] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:31.070322 17321 tablet_copy_client.cc:538] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:31.077536 17316 tablet_copy_client.cc:538] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:31.080531 17321 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:31.095095 17316 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:31.110880 17321 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:31.111901 17321 tablet_bootstrap.cc:492] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:31.112587 17321 ts_tablet_manager.cc:1403] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.032s user 0.014s sys 0.014s
I20260204 08:58:31.115459 17321 raft_consensus.cc:359] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:31.116362 17321 raft_consensus.cc:740] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:31.117033 17321 consensus_queue.cc:260] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:31.129297 17312 ts_tablet_manager.cc:933] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:31.131775 17321 ts_tablet_manager.cc:1434] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260204 08:58:31.133328 16542 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-61ec06ad82864d3a91228c325fd1af2d received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:31.133754 16542 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-61ec06ad82864d3a91228c325fd1af2d on tablet 61ec06ad82864d3a91228c325fd1af2d with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:31.156426 17312 tablet_copy_client.cc:323] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:31.171331 17316 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:31.172348 17316 tablet_bootstrap.cc:492] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:31.173007 17316 ts_tablet_manager.cc:1403] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.078s user 0.017s sys 0.010s
I20260204 08:58:31.180660 17316 raft_consensus.cc:359] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:31.181437 17316 raft_consensus.cc:740] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:31.182024 17316 consensus_queue.cc:260] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:31.194034 17316 ts_tablet_manager.cc:1434] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.021s user 0.006s sys 0.001s
I20260204 08:58:31.194353 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 457a55a8c34648f6ae2a009fcb9fd749 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:31.194998 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 457a55a8c34648f6ae2a009fcb9fd749 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-457a55a8c34648f6ae2a009fcb9fd749
I20260204 08:58:31.195616 16542 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-810a9a6b2d154b6d9a7b8c4d2db5f692 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:31.196084 16542 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-810a9a6b2d154b6d9a7b8c4d2db5f692 on tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:31.203205 16691 tablet_copy_source_session.cc:215] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:31.206215 17312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457a55a8c34648f6ae2a009fcb9fd749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:31.225814 17312 tablet_copy_client.cc:806] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:31.226384 17312 tablet_copy_client.cc:670] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:31.235064 17312 tablet_copy_client.cc:538] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:31.242808 17312 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:31.266337 17312 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:31.267290 17312 tablet_bootstrap.cc:492] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:31.267978 17312 ts_tablet_manager.cc:1403] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.009s
I20260204 08:58:31.272442 17312 raft_consensus.cc:359] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:31.273355 17312 raft_consensus.cc:740] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:31.274170 17312 consensus_queue.cc:260] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:31.279703 17312 ts_tablet_manager.cc:1434] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20260204 08:58:31.283855 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-457a55a8c34648f6ae2a009fcb9fd749 received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:31.284287 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-457a55a8c34648f6ae2a009fcb9fd749 on tablet 457a55a8c34648f6ae2a009fcb9fd749 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:31.384531 17253 raft_consensus.cc:1217] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:31.508301 17253 raft_consensus.cc:1217] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:31.558926 17253 raft_consensus.cc:1217] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:31.655527 17253 raft_consensus.cc:1217] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:31.863869 17330 raft_consensus.cc:1064] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:31.869093 17330 consensus_queue.cc:237] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:31.877166 16531 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:31.878072 17253 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:31.880694 17293 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:31.882771 17100 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:31.890347 16673 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:31.898011 17334 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260204 08:58:31.917328 17100 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:31.918939 16524 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:31.932324 16673 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:31.938139 17253 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:31.941313 16429 catalog_manager.cc:5654] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:31.965410 17183 raft_consensus.cc:1064] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:31.968279 17183 consensus_queue.cc:237] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:31.984256 16673 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:31.985860 17323 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:31.989430 17253 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:31.990777 17303 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:31.997736 16600 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:32.000860 17183 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:32.018034 17303 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.019874 16600 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.033535 16674 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.034169 17253 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.080214 16427 catalog_manager.cc:5654] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.095432 16531 consensus_queue.cc:237] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:32.103053 17253 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:32.103531 16674 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:32.104887 17346 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:58:32.108063 17303 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:32.115087 17346 raft_consensus.cc:1064] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:32.117726 17323 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.124186 17253 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.121781 16673 raft_consensus.cc:2955] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.135409 17346 consensus_queue.cc:237] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:32.141741 16430 catalog_manager.cc:5654] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.155766 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:32.155961 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:32.174520 17348 tablet_replica.cc:333] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:32.175607 17348 raft_consensus.cc:2243] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:32.180729 17348 raft_consensus.cc:2272] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:32.190579 17253 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:32.192389 17346 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:32.193068 16673 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:32.196899 16601 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:32.197227 17348 ts_tablet_manager.cc:1916] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:32.203253 17346 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:32.204295 17332 raft_consensus.cc:1064] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:32.206697 17332 consensus_queue.cc:237] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:32.209048 17303 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:32.251715 17348 ts_tablet_manager.cc:1929] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:32.252403 17348 log.cc:1199] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/810a9a6b2d154b6d9a7b8c4d2db5f692
I20260204 08:58:32.254173 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 810a9a6b2d154b6d9a7b8c4d2db5f692 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:32.260053 16601 raft_consensus.cc:1275] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:32.261339 17332 consensus_queue.cc:1048] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:32.262176 16531 raft_consensus.cc:1275] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:32.263725 17325 consensus_queue.cc:1048] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:32.266700 17253 raft_consensus.cc:1275] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:32.272272 17349 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.275825 16674 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.283777 17325 consensus_queue.cc:1048] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:32.292961 16600 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.302371 17253 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.309978 16734 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.312076 16429 catalog_manager.cc:5654] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:32.319429 16603 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.333647 17253 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.345831 16531 consensus_queue.cc:237] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:32.352710 16430 catalog_manager.cc:5654] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:32.358810 17252 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:32.364284 17323 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:32.367861 16524 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.371273 16603 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:32.385387 17183 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:32.387110 17183 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.389460 17253 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.399820 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 61ec06ad82864d3a91228c325fd1af2d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:32.406828 16429 catalog_manager.cc:5654] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:32.413884 16600 raft_consensus.cc:2955] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.419327 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 61ec06ad82864d3a91228c325fd1af2d with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:32.437079 16673 consensus_queue.cc:237] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:32.438154 17358 tablet_replica.cc:333] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:32.450109 17253 raft_consensus.cc:1275] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:32.450604 16531 raft_consensus.cc:1275] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:32.451436 16734 consensus_queue.cc:1048] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:58:32.453398 17325 consensus_queue.cc:1048] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:32.460467 17325 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.463050 17253 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.473595 17358 raft_consensus.cc:2243] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:32.474370 17358 raft_consensus.cc:2272] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:32.472075 16531 raft_consensus.cc:2955] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.476315 16603 consensus_queue.cc:237] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:32.477703 17358 ts_tablet_manager.cc:1916] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:32.481191 17252 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:32.482213 16674 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:32.484263 17334 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:32.485870 17334 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:32.492446 17330 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.497752 17252 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.496260 16429 catalog_manager.cc:5654] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.497397 16674 raft_consensus.cc:2955] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:32.513545 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 0b534820859442b49b61eb04ce7e2363 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:32.518739 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 457a55a8c34648f6ae2a009fcb9fd749 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:32.520540 17348 tablet_replica.cc:333] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:32.534122 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 457a55a8c34648f6ae2a009fcb9fd749 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:32.539849 17348 raft_consensus.cc:2243] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:32.540731 17348 raft_consensus.cc:2272] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:32.546370 17348 ts_tablet_manager.cc:1916] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:32.562500 17358 ts_tablet_manager.cc:1929] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:32.563063 17358 log.cc:1199] T 61ec06ad82864d3a91228c325fd1af2d P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/61ec06ad82864d3a91228c325fd1af2d
I20260204 08:58:32.564922 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 61ec06ad82864d3a91228c325fd1af2d (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:32.566022 17348 ts_tablet_manager.cc:1929] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:32.566550 17348 log.cc:1199] T 457a55a8c34648f6ae2a009fcb9fd749 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/457a55a8c34648f6ae2a009fcb9fd749
I20260204 08:58:32.568173 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 457a55a8c34648f6ae2a009fcb9fd749 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:32.519562 16430 catalog_manager.cc:5654] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:32.579888 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 0b534820859442b49b61eb04ce7e2363 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:32.606309 17359 tablet_replica.cc:333] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:32.607441 17359 raft_consensus.cc:2243] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:32.608167 17359 raft_consensus.cc:2272] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:32.610967 17359 ts_tablet_manager.cc:1916] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:32.626384 17359 ts_tablet_manager.cc:1929] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:32.626822 17359 log.cc:1199] T 0b534820859442b49b61eb04ce7e2363 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/0b534820859442b49b61eb04ce7e2363
I20260204 08:58:32.629456 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 0b534820859442b49b61eb04ce7e2363 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:33.650403 16599 consensus_queue.cc:237] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:33.658241 16673 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:33.659684 17334 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:58:33.662612 16573 consensus_peers.cc:597] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3018fb4c08d3462f90e72e4df6d716c8. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:33.663311 16524 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:33.666551 17334 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:33.679684 17334 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.684382 16673 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.686051 16524 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.694425 16603 consensus_queue.cc:237] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:33.706751 16524 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:33.707599 16680 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:33.708987 17365 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:33.711452 17330 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:58:33.713388 16573 consensus_peers.cc:597] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aac4f009108d4057aee3fb4274b6d320. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:33.703351 16426 catalog_manager.cc:5654] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:33.745361 17334 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.755280 16524 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.767879 16680 consensus_queue.cc:237] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:33.777938 16429 catalog_manager.cc:5654] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:33.793576 16673 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.806002 16531 raft_consensus.cc:1275] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:33.809583 16599 raft_consensus.cc:1275] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:33.810911 16734 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:58:33.812763 16647 consensus_peers.cc:597] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10d633fea539421b8df68b6b69649892. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:33.818331 17360 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:33.828982 16524 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.827314 16734 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.835834 16599 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.846134 16429 catalog_manager.cc:5654] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.850900 16673 consensus_queue.cc:237] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:33.879787 16524 raft_consensus.cc:1275] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:33.881326 17377 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:33.889513 16599 raft_consensus.cc:1275] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:33.891222 16647 consensus_peers.cc:597] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 147ea8d1b63e4e9e8f084676f3f0ea12. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:33.893452 17377 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:33.911870 16734 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.920606 16531 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.925030 16603 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:33.933918 16429 catalog_manager.cc:5654] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:34.078555 17381 ts_tablet_manager.cc:933] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:34.082638 17381 tablet_copy_client.cc:323] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:34.084447 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 3018fb4c08d3462f90e72e4df6d716c8 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:34.084945 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 3018fb4c08d3462f90e72e4df6d716c8 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-3018fb4c08d3462f90e72e4df6d716c8
I20260204 08:58:34.092078 16617 tablet_copy_source_session.cc:215] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:34.095474 17381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3018fb4c08d3462f90e72e4df6d716c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:34.101222 17383 ts_tablet_manager.cc:933] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:34.115272 17381 tablet_copy_client.cc:806] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:34.115868 17381 tablet_copy_client.cc:670] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:34.116861 17383 tablet_copy_client.cc:323] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:34.121160 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet aac4f009108d4057aee3fb4274b6d320 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:34.121697 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet aac4f009108d4057aee3fb4274b6d320 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-aac4f009108d4057aee3fb4274b6d320
I20260204 08:58:34.124183 17381 tablet_copy_client.cc:538] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:34.142727 17381 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:34.172045 16617 tablet_copy_source_session.cc:215] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:34.176666 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac4f009108d4057aee3fb4274b6d320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:34.192515 17381 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:34.193234 17381 tablet_bootstrap.cc:492] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:34.193813 17381 ts_tablet_manager.cc:1403] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.051s user 0.016s sys 0.004s
I20260204 08:58:34.195634 17383 tablet_copy_client.cc:806] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:34.196254 17383 tablet_copy_client.cc:670] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:34.195933 17381 raft_consensus.cc:359] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:34.197649 17381 raft_consensus.cc:740] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:34.198323 17381 consensus_queue.cc:260] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:34.199879 17383 tablet_copy_client.cc:538] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:34.211894 17383 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:34.243891 17381 ts_tablet_manager.cc:1434] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.050s user 0.020s sys 0.019s
I20260204 08:58:34.246474 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-3018fb4c08d3462f90e72e4df6d716c8 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:34.246881 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-3018fb4c08d3462f90e72e4df6d716c8 on tablet 3018fb4c08d3462f90e72e4df6d716c8 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:34.250083 17383 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:34.251087 17383 tablet_bootstrap.cc:492] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:34.251796 17383 ts_tablet_manager.cc:1403] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.040s user 0.030s sys 0.002s
I20260204 08:58:34.254544 17383 raft_consensus.cc:359] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:34.255399 17383 raft_consensus.cc:740] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:34.256062 17383 consensus_queue.cc:260] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:34.258399 17383 ts_tablet_manager.cc:1434] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:58:34.260187 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-aac4f009108d4057aee3fb4274b6d320 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:34.260562 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-aac4f009108d4057aee3fb4274b6d320 on tablet aac4f009108d4057aee3fb4274b6d320 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:34.288647 17383 ts_tablet_manager.cc:933] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:34.291792 17383 tablet_copy_client.cc:323] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:34.293406 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 10d633fea539421b8df68b6b69649892 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:34.293915 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 10d633fea539421b8df68b6b69649892 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-10d633fea539421b8df68b6b69649892
I20260204 08:58:34.300395 16691 tablet_copy_source_session.cc:215] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:34.306094 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d633fea539421b8df68b6b69649892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:34.323519 17383 tablet_copy_client.cc:806] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:34.324131 17383 tablet_copy_client.cc:670] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:34.330686 17383 tablet_copy_client.cc:538] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:34.340735 17383 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:34.360114 17383 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:34.360880 17383 tablet_bootstrap.cc:492] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:34.361483 17383 ts_tablet_manager.cc:1403] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.021s user 0.019s sys 0.000s
I20260204 08:58:34.363983 17383 raft_consensus.cc:359] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:34.364781 17383 raft_consensus.cc:740] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:34.365322 17383 consensus_queue.cc:260] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:34.367818 17383 ts_tablet_manager.cc:1434] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260204 08:58:34.369558 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-10d633fea539421b8df68b6b69649892 received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:34.369885 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-10d633fea539421b8df68b6b69649892 on tablet 10d633fea539421b8df68b6b69649892 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:34.399169 17383 ts_tablet_manager.cc:933] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:34.400924 17383 tablet_copy_client.cc:323] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:34.402354 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 147ea8d1b63e4e9e8f084676f3f0ea12 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:34.402871 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 147ea8d1b63e4e9e8f084676f3f0ea12 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-147ea8d1b63e4e9e8f084676f3f0ea12
I20260204 08:58:34.409876 16691 tablet_copy_source_session.cc:215] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:34.413241 17383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147ea8d1b63e4e9e8f084676f3f0ea12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:34.432047 17383 tablet_copy_client.cc:806] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:34.432793 17383 tablet_copy_client.cc:670] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:34.448973 17383 tablet_copy_client.cc:538] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:34.467003 17383 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:34.485864 17383 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:34.486657 17383 tablet_bootstrap.cc:492] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:34.487232 17383 ts_tablet_manager.cc:1403] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.000s
I20260204 08:58:34.489529 17383 raft_consensus.cc:359] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:34.490259 17383 raft_consensus.cc:740] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:34.490826 17383 consensus_queue.cc:260] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:34.492961 17383 ts_tablet_manager.cc:1434] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.005s user 0.005s sys 0.003s
I20260204 08:58:34.497511 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-147ea8d1b63e4e9e8f084676f3f0ea12 received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:34.497884 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-147ea8d1b63e4e9e8f084676f3f0ea12 on tablet 147ea8d1b63e4e9e8f084676f3f0ea12 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:34.588642 17253 raft_consensus.cc:1217] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:34.601684 17253 raft_consensus.cc:1217] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:34.869992 17253 raft_consensus.cc:1217] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:34.993757 17253 raft_consensus.cc:1217] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:35.022820 17334 raft_consensus.cc:1064] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:35.025053 17334 consensus_queue.cc:237] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:35.031610 17253 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.031800 16680 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.032343 16524 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.033545 17392 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.034201 17365 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.034994 17394 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.057652 17365 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.059113 16524 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.066733 16680 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.079793 16429 catalog_manager.cc:5654] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:35.081103 17253 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.113248 16600 consensus_queue.cc:237] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:35.117403 16680 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:35.117403 17253 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:35.118788 17394 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:35.120240 17394 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:35.126224 17334 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.132895 17252 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.136610 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3018fb4c08d3462f90e72e4df6d716c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:35.136806 16674 raft_consensus.cc:2955] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.146548 16427 catalog_manager.cc:5654] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:35.161366 17399 raft_consensus.cc:1064] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:35.162573 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 3018fb4c08d3462f90e72e4df6d716c8 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:35.163586 17399 consensus_queue.cc:237] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:35.167157 17404 tablet_replica.cc:333] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:35.167955 17404 raft_consensus.cc:2243] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:35.168632 17404 raft_consensus.cc:2272] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:35.172539 16525 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.172606 16680 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.174284 17399 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.174896 17252 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.175377 17334 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.176303 17365 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.177771 17404 ts_tablet_manager.cc:1916] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:35.203047 17365 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.204972 17252 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.205454 16674 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.212484 17404 ts_tablet_manager.cc:1929] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:35.212991 17404 log.cc:1199] T 3018fb4c08d3462f90e72e4df6d716c8 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/3018fb4c08d3462f90e72e4df6d716c8
I20260204 08:58:35.216058 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 3018fb4c08d3462f90e72e4df6d716c8 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:35.217586 16427 catalog_manager.cc:5654] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.218021 16525 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.235286 16600 consensus_queue.cc:237] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:35.241206 16525 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:35.242486 17334 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:35.249423 17399 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.257453 16524 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.260347 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet aac4f009108d4057aee3fb4274b6d320 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:35.264590 17252 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:35.266858 17399 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:35.270260 16426 catalog_manager.cc:5654] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:35.272392 17252 raft_consensus.cc:2955] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.284727 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet aac4f009108d4057aee3fb4274b6d320 with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:35.287070 17409 tablet_replica.cc:333] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:35.288107 17409 raft_consensus.cc:2243] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:35.291348 17409 raft_consensus.cc:2272] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:35.295627 17409 ts_tablet_manager.cc:1916] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:35.315176 17409 ts_tablet_manager.cc:1929] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:35.315588 17409 log.cc:1199] T aac4f009108d4057aee3fb4274b6d320 P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/aac4f009108d4057aee3fb4274b6d320
I20260204 08:58:35.316809 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet aac4f009108d4057aee3fb4274b6d320 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:35.372359 16734 raft_consensus.cc:1064] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:35.375350 16734 consensus_queue.cc:237] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:35.380441 17252 raft_consensus.cc:1275] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.380642 16600 raft_consensus.cc:1275] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.381045 16531 raft_consensus.cc:1275] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.381978 16734 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:35.382956 17373 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.384002 17377 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.413218 17411 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.414916 17252 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.418576 16600 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.425431 16524 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.430320 16430 catalog_manager.cc:5654] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:35.457497 16673 consensus_queue.cc:237] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:35.462257 17252 raft_consensus.cc:1275] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:35.462491 16600 raft_consensus.cc:1275] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:35.463338 17373 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:35.464340 17411 consensus_queue.cc:1048] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:35.470492 17373 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.472029 17252 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.482786 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 10d633fea539421b8df68b6b69649892 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:35.484525 16601 raft_consensus.cc:2955] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.486146 16429 catalog_manager.cc:5654] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.498733 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 10d633fea539421b8df68b6b69649892 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:35.499696 17404 tablet_replica.cc:333] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:35.500615 17404 raft_consensus.cc:2243] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:35.501283 17404 raft_consensus.cc:2272] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:35.504146 17404 ts_tablet_manager.cc:1916] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:35.518756 17404 ts_tablet_manager.cc:1929] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:35.519199 17404 log.cc:1199] T 10d633fea539421b8df68b6b69649892 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/10d633fea539421b8df68b6b69649892
I20260204 08:58:35.521006 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 10d633fea539421b8df68b6b69649892 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:35.603740 16734 raft_consensus.cc:1064] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:35.605767 16734 consensus_queue.cc:237] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:35.611096 16600 raft_consensus.cc:1275] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.611224 17252 raft_consensus.cc:1275] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.612524 17373 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.613200 16524 raft_consensus.cc:1275] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:35.613430 16734 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:35.614820 17377 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:35.623059 17373 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.624020 16524 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.626139 16600 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.636468 17252 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.638813 16429 catalog_manager.cc:5654] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:35.652689 16680 consensus_queue.cc:237] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:35.661201 17252 raft_consensus.cc:1275] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:35.662530 16734 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:35.665086 16524 raft_consensus.cc:1275] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:35.666457 17373 consensus_queue.cc:1048] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:35.670557 17411 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.671947 17253 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.674875 16524 raft_consensus.cc:2955] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.681087 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 147ea8d1b63e4e9e8f084676f3f0ea12 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:35.686987 16429 catalog_manager.cc:5654] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:35.701407 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 147ea8d1b63e4e9e8f084676f3f0ea12 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:35.703051 17419 tablet_replica.cc:333] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:35.703744 17419 raft_consensus.cc:2243] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:35.704305 17419 raft_consensus.cc:2272] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:35.709687 17419 ts_tablet_manager.cc:1916] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:35.722378 17419 ts_tablet_manager.cc:1929] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:35.723477 17419 log.cc:1199] T 147ea8d1b63e4e9e8f084676f3f0ea12 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/147ea8d1b63e4e9e8f084676f3f0ea12
I20260204 08:58:35.725332 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 147ea8d1b63e4e9e8f084676f3f0ea12 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:36.747325 16601 consensus_queue.cc:237] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:36.752257 16680 raft_consensus.cc:1275] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:36.752498 16525 raft_consensus.cc:1275] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:36.752698 16573 consensus_peers.cc:597] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a1d2d7d1f3440c48f319087b6e44ee0. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:36.753376 17399 consensus_queue.cc:1048] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:36.754041 17334 consensus_queue.cc:1048] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:36.761021 17399 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.762434 16680 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.762991 16525 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.775161 16426 catalog_manager.cc:5654] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.776773 16680 consensus_queue.cc:237] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:36.791185 16525 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:36.793705 16647 consensus_peers.cc:597] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8c54bb34a3c42489cc93960f1717406. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:36.796387 17377 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:36.796649 16601 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:36.798568 17427 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:36.807473 17377 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.808995 16525 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.815155 16601 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.821309 16524 consensus_queue.cc:237] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:36.826710 16426 catalog_manager.cc:5654] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:36.840505 16680 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:36.840936 16498 consensus_peers.cc:597] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bff71b9804b47cc915e34b23012509e. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:36.842133 16601 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:36.841945 17323 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:36.845930 17323 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:36.870631 17436 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.872593 16680 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.877542 16600 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.888756 16525 consensus_queue.cc:237] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:36.890615 16426 catalog_manager.cc:5654] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:36.900828 16680 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:36.902258 16600 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:36.902258 17437 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260204 08:58:36.909230 16498 consensus_peers.cc:597] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 063bb12920e44068a818b00a8573328e. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:36.911756 17437 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:36.918922 17323 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.921854 16601 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.922230 16680 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:36.934235 16427 catalog_manager.cc:5654] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:37.273540 17441 ts_tablet_manager.cc:933] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:37.275400 17441 tablet_copy_client.cc:323] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:37.276686 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 6a1d2d7d1f3440c48f319087b6e44ee0 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:37.277171 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 6a1d2d7d1f3440c48f319087b6e44ee0 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-6a1d2d7d1f3440c48f319087b6e44ee0
I20260204 08:58:37.282945 16617 tablet_copy_source_session.cc:215] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:37.285591 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1d2d7d1f3440c48f319087b6e44ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:37.296911 17441 tablet_copy_client.cc:806] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:37.297534 17441 tablet_copy_client.cc:670] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:37.301782 17441 tablet_copy_client.cc:538] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:37.309000 17441 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:37.325878 17441 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:37.326730 17441 tablet_bootstrap.cc:492] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:37.327389 17441 ts_tablet_manager.cc:1403] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.019s user 0.018s sys 0.000s
I20260204 08:58:37.329221 17444 ts_tablet_manager.cc:933] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:37.330013 17441 raft_consensus.cc:359] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:37.330983 17441 raft_consensus.cc:740] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:37.332444 17441 consensus_queue.cc:260] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:37.337458 17444 tablet_copy_client.cc:323] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:37.339146 16542 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 4bff71b9804b47cc915e34b23012509e from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:37.339692 16542 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 4bff71b9804b47cc915e34b23012509e from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-4bff71b9804b47cc915e34b23012509e
I20260204 08:58:37.341631 17446 ts_tablet_manager.cc:933] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:37.344286 17441 ts_tablet_manager.cc:1434] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.016s user 0.006s sys 0.005s
I20260204 08:58:37.345585 17446 tablet_copy_client.cc:323] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:37.347131 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-6a1d2d7d1f3440c48f319087b6e44ee0 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:37.347536 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-6a1d2d7d1f3440c48f319087b6e44ee0 on tablet 6a1d2d7d1f3440c48f319087b6e44ee0 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:37.348536 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 063bb12920e44068a818b00a8573328e from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:37.349025 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 063bb12920e44068a818b00a8573328e from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-063bb12920e44068a818b00a8573328e
I20260204 08:58:37.349866 16542 tablet_copy_source_session.cc:215] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:37.354884 17444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bff71b9804b47cc915e34b23012509e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:37.355080 16541 tablet_copy_source_session.cc:215] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:37.369000 17444 tablet_copy_client.cc:806] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:37.369630 17444 tablet_copy_client.cc:670] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:37.370026 17446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063bb12920e44068a818b00a8573328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:37.373497 17444 tablet_copy_client.cc:538] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:37.380379 17444 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:37.393879 17441 ts_tablet_manager.cc:933] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:37.412621 17444 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:37.413687 17444 tablet_bootstrap.cc:492] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:37.414538 17444 ts_tablet_manager.cc:1403] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.034s user 0.025s sys 0.003s
I20260204 08:58:37.418752 17446 tablet_copy_client.cc:806] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:37.418453 17444 raft_consensus.cc:359] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:37.419296 17446 tablet_copy_client.cc:670] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:37.419373 17444 raft_consensus.cc:740] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:37.422950 17444 consensus_queue.cc:260] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:37.425662 17444 ts_tablet_manager.cc:1434] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260204 08:58:37.426434 17446 tablet_copy_client.cc:538] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:37.429598 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-4bff71b9804b47cc915e34b23012509e received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:37.429987 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-4bff71b9804b47cc915e34b23012509e on tablet 4bff71b9804b47cc915e34b23012509e with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:37.446553 17441 tablet_copy_client.cc:323] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:37.448006 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet d8c54bb34a3c42489cc93960f1717406 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:37.448529 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet d8c54bb34a3c42489cc93960f1717406 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-d8c54bb34a3c42489cc93960f1717406
I20260204 08:58:37.454581 16691 tablet_copy_source_session.cc:215] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:37.457516 17446 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:37.459945 17441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c54bb34a3c42489cc93960f1717406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:37.473575 17441 tablet_copy_client.cc:806] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:37.474082 17441 tablet_copy_client.cc:670] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:37.477180 17441 tablet_copy_client.cc:538] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:37.488932 17441 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:37.493901 17446 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:37.494937 17446 tablet_bootstrap.cc:492] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:37.495726 17446 ts_tablet_manager.cc:1403] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.038s user 0.020s sys 0.005s
I20260204 08:58:37.498505 17446 raft_consensus.cc:359] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:37.499068 17446 raft_consensus.cc:740] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:37.499639 17446 consensus_queue.cc:260] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:37.508791 17446 ts_tablet_manager.cc:1434] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260204 08:58:37.510288 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-063bb12920e44068a818b00a8573328e received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:37.510620 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-063bb12920e44068a818b00a8573328e on tablet 063bb12920e44068a818b00a8573328e with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:37.519876 17441 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:37.520742 17441 tablet_bootstrap.cc:492] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:37.521425 17441 ts_tablet_manager.cc:1403] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.033s user 0.015s sys 0.010s
I20260204 08:58:37.523861 17441 raft_consensus.cc:359] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:37.524614 17441 raft_consensus.cc:740] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:37.525223 17441 consensus_queue.cc:260] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:37.527503 17441 ts_tablet_manager.cc:1434] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260204 08:58:37.528891 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-d8c54bb34a3c42489cc93960f1717406 received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:37.529258 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-d8c54bb34a3c42489cc93960f1717406 on tablet d8c54bb34a3c42489cc93960f1717406 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:37.788483 17253 raft_consensus.cc:1217] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:37.815936 17253 raft_consensus.cc:1217] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:37.838187 17253 raft_consensus.cc:1217] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:37.862356 17253 raft_consensus.cc:1217] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:38.198163 17437 raft_consensus.cc:1064] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:38.200598 17437 consensus_queue.cc:237] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:38.206056 17253 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.206103 16673 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.207440 17453 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.209035 16603 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.211298 17453 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.213151 17437 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.225260 17323 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.226723 16603 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.233074 17253 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.235730 16680 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.247022 16426 catalog_manager.cc:5654] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:38.282433 16525 consensus_queue.cc:237] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:38.286957 16673 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:38.288065 17437 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:38.288973 17253 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:38.292093 17437 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:38.294518 17323 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.298086 16680 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.309008 17253 raft_consensus.cc:2955] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.310353 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 063bb12920e44068a818b00a8573328e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:38.314383 16430 catalog_manager.cc:5654] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.329185 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 063bb12920e44068a818b00a8573328e with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:38.333359 17465 tablet_replica.cc:333] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:38.334616 17465 raft_consensus.cc:2243] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:38.335335 17465 raft_consensus.cc:2272] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:38.338883 17465 ts_tablet_manager.cc:1916] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:38.352710 17465 ts_tablet_manager.cc:1929] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:38.352984 17465 log.cc:1199] T 063bb12920e44068a818b00a8573328e P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/063bb12920e44068a818b00a8573328e
I20260204 08:58:38.354174 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 063bb12920e44068a818b00a8573328e (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:38.364174 17399 raft_consensus.cc:1064] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:38.365216 17411 raft_consensus.cc:1064] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:38.366268 17399 consensus_queue.cc:237] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:38.366890 17411 consensus_queue.cc:237] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:38.376299 17253 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.379772 16525 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.381342 17454 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.382512 16603 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.382870 17460 raft_consensus.cc:1064] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:38.384754 16673 raft_consensus.cc:1275] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.384670 17468 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:38.385355 17460 consensus_queue.cc:237] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:38.386215 17253 raft_consensus.cc:1275] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.386256 17421 consensus_queue.cc:1048] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.387229 16525 raft_consensus.cc:1275] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.389127 17468 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.394758 17455 consensus_queue.cc:1048] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.396528 17455 consensus_queue.cc:1048] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.425261 17421 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.432770 16680 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.432776 17253 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.436604 16603 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:38.436532 17453 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:38.437639 17253 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.442220 17453 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.445066 17468 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.447639 16674 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.434939 16525 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.459506 17460 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:38.460403 16429 catalog_manager.cc:5654] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:38.468420 17253 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.468914 16600 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.479050 16524 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.486740 16599 consensus_queue.cc:237] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:38.499169 17251 raft_consensus.cc:1275] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:38.500692 17453 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.504884 17399 consensus_queue.cc:1048] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:38.510422 16427 catalog_manager.cc:5654] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.507193 17252 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.520787 16524 raft_consensus.cc:1275] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:38.520052 17421 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.522068 17455 consensus_queue.cc:1048] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:38.526366 16524 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.534150 16680 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.527789 17251 raft_consensus.cc:2955] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.551236 16599 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.552675 16430 catalog_manager.cc:5654] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.570142 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 6a1d2d7d1f3440c48f319087b6e44ee0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:38.571929 16525 consensus_queue.cc:237] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:38.576876 17252 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:38.578078 17460 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:38.583410 16430 catalog_manager.cc:5654] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.588550 17453 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.588680 17252 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.598992 16600 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:38.601536 16673 consensus_queue.cc:237] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:38.607071 17460 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260204 08:58:38.610329 16647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 74296us
I20260204 08:58:38.611037 16600 raft_consensus.cc:2955] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.616758 16606 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:38.620146 17253 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:38.626617 17481 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:38.629415 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 6a1d2d7d1f3440c48f319087b6e44ee0 with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:38.629659 17468 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:38.636595 17468 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.637717 16430 catalog_manager.cc:5654] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.639683 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4bff71b9804b47cc915e34b23012509e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:38.639778 16600 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.645913 17252 raft_consensus.cc:2955] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.648626 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d8c54bb34a3c42489cc93960f1717406 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:38.659791 17483 tablet_replica.cc:333] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:38.660456 17483 raft_consensus.cc:2243] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:38.661098 17483 raft_consensus.cc:2272] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:38.665380 17483 ts_tablet_manager.cc:1916] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:38.673645 16430 catalog_manager.cc:5654] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:38.677197 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 4bff71b9804b47cc915e34b23012509e with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:38.685900 17483 ts_tablet_manager.cc:1929] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:38.686347 17483 log.cc:1199] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/6a1d2d7d1f3440c48f319087b6e44ee0
I20260204 08:58:38.688077 17483 tablet_replica.cc:333] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:38.689064 17483 raft_consensus.cc:2243] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:38.689203 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet d8c54bb34a3c42489cc93960f1717406 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:38.689706 17483 raft_consensus.cc:2272] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:38.688050 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 6a1d2d7d1f3440c48f319087b6e44ee0 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:38.692193 17484 tablet_replica.cc:333] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:38.694689 17484 raft_consensus.cc:2243] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:38.693688 17483 ts_tablet_manager.cc:1916] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:38.697093 17484 raft_consensus.cc:2272] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:38.700052 17484 ts_tablet_manager.cc:1916] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:38.720000 17483 ts_tablet_manager.cc:1929] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:38.720327 17484 ts_tablet_manager.cc:1929] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:38.720455 17483 log.cc:1199] T 4bff71b9804b47cc915e34b23012509e P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/4bff71b9804b47cc915e34b23012509e
I20260204 08:58:38.720757 17484 log.cc:1199] T d8c54bb34a3c42489cc93960f1717406 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/d8c54bb34a3c42489cc93960f1717406
I20260204 08:58:38.722288 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet d8c54bb34a3c42489cc93960f1717406 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:38.722908 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 4bff71b9804b47cc915e34b23012509e (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:39.726387 16674 consensus_queue.cc:237] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:39.732993 16526 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:39.732944 16647 consensus_peers.cc:597] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af129226cb2f41479ef5eb75771c860b. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:39.733110 16606 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:39.734519 17481 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:39.735410 17411 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:39.743755 17481 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.749603 16526 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.749706 16603 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.758445 16531 consensus_queue.cc:237] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:39.764504 16429 catalog_manager.cc:5654] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:39.788743 16674 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:39.789230 16603 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:39.789980 17453 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260204 08:58:39.789949 16498 consensus_peers.cc:597] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7f0ef5121b748d18bbd7783a318fbc7. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:39.791730 17460 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:39.803594 17460 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.808682 16606 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.825534 16674 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.829540 16531 consensus_queue.cc:237] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
W20260204 08:58:39.842585 16498 consensus_peers.cc:597] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4a8f14fd5174a4d98b1849c67325173. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:39.844162 16606 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:39.845436 17460 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:39.847280 16430 catalog_manager.cc:5654] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:39.856981 16678 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:39.859108 17491 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:39.875308 16678 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.876235 16603 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.873777 17491 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.895471 16426 catalog_manager.cc:5654] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.898288 16531 consensus_queue.cc:237] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:39.905927 16603 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:39.906692 16678 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:39.907321 17501 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:39.908201 17491 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:58:39.911837 16498 consensus_peers.cc:597] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 801ee654117f4d37b4ad0c66b46fd4e4. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:39.921871 17491 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.922662 16603 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.924975 16678 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:39.941298 16427 catalog_manager.cc:5654] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:40.311319 17506 ts_tablet_manager.cc:933] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:40.313143 17506 tablet_copy_client.cc:323] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:40.314909 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet d7f0ef5121b748d18bbd7783a318fbc7 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:40.315459 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet d7f0ef5121b748d18bbd7783a318fbc7 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-d7f0ef5121b748d18bbd7783a318fbc7
I20260204 08:58:40.323607 16541 tablet_copy_source_session.cc:215] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:40.327096 17506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f0ef5121b748d18bbd7783a318fbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:40.339439 17506 tablet_copy_client.cc:806] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:40.340031 17506 tablet_copy_client.cc:670] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:40.341236 17508 ts_tablet_manager.cc:933] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:40.343418 17506 tablet_copy_client.cc:538] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:40.343860 17508 tablet_copy_client.cc:323] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:40.345420 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet af129226cb2f41479ef5eb75771c860b from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:40.345925 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet af129226cb2f41479ef5eb75771c860b from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-af129226cb2f41479ef5eb75771c860b
I20260204 08:58:40.350436 17506 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:40.352752 16691 tablet_copy_source_session.cc:215] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:40.360291 17510 ts_tablet_manager.cc:933] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:40.362332 17508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af129226cb2f41479ef5eb75771c860b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:40.379418 17510 tablet_copy_client.cc:323] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:40.381093 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet b4a8f14fd5174a4d98b1849c67325173 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:40.381495 17508 tablet_copy_client.cc:806] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:40.381605 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet b4a8f14fd5174a4d98b1849c67325173 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-b4a8f14fd5174a4d98b1849c67325173
I20260204 08:58:40.382050 17508 tablet_copy_client.cc:670] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:40.385648 17508 tablet_copy_client.cc:538] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:40.388267 17506 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:40.388300 16541 tablet_copy_source_session.cc:215] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:40.389330 17506 tablet_bootstrap.cc:492] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:40.391424 17510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a8f14fd5174a4d98b1849c67325173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:40.391418 17506 ts_tablet_manager.cc:1403] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.041s user 0.020s sys 0.012s
I20260204 08:58:40.395162 17506 raft_consensus.cc:359] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:40.397419 17506 raft_consensus.cc:740] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:40.398190 17506 consensus_queue.cc:260] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:40.396606 17508 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:40.410485 17510 tablet_copy_client.cc:806] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:40.410953 17510 tablet_copy_client.cc:670] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:40.413133 17506 ts_tablet_manager.cc:1434] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260204 08:58:40.414649 17510 tablet_copy_client.cc:538] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:40.415835 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-d7f0ef5121b748d18bbd7783a318fbc7 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:40.416293 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-d7f0ef5121b748d18bbd7783a318fbc7 on tablet d7f0ef5121b748d18bbd7783a318fbc7 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:40.431437 17508 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:40.432314 17508 tablet_bootstrap.cc:492] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:40.432931 17508 ts_tablet_manager.cc:1403] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.037s user 0.019s sys 0.006s
I20260204 08:58:40.433293 17510 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:40.437219 17508 raft_consensus.cc:359] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:40.437987 17508 raft_consensus.cc:740] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:40.438583 17508 consensus_queue.cc:260] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:40.441397 17508 ts_tablet_manager.cc:1434] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260204 08:58:40.442790 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-af129226cb2f41479ef5eb75771c860b received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:40.443193 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-af129226cb2f41479ef5eb75771c860b on tablet af129226cb2f41479ef5eb75771c860b with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:40.462601 17510 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:40.463456 17510 tablet_bootstrap.cc:492] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:40.464036 17510 ts_tablet_manager.cc:1403] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.014s
I20260204 08:58:40.466140 17510 raft_consensus.cc:359] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:40.466708 17510 raft_consensus.cc:740] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:40.467172 17510 consensus_queue.cc:260] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:40.469738 17510 ts_tablet_manager.cc:1434] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:58:40.471124 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-b4a8f14fd5174a4d98b1849c67325173 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:40.471495 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-b4a8f14fd5174a4d98b1849c67325173 on tablet b4a8f14fd5174a4d98b1849c67325173 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:40.520576 17510 ts_tablet_manager.cc:933] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:40.522053 17510 tablet_copy_client.cc:323] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:40.523321 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 801ee654117f4d37b4ad0c66b46fd4e4 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:40.523766 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 801ee654117f4d37b4ad0c66b46fd4e4 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-801ee654117f4d37b4ad0c66b46fd4e4
I20260204 08:58:40.531713 16541 tablet_copy_source_session.cc:215] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:40.535027 17510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801ee654117f4d37b4ad0c66b46fd4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:40.548475 17510 tablet_copy_client.cc:806] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:40.548934 17510 tablet_copy_client.cc:670] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:40.551918 17510 tablet_copy_client.cc:538] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:40.559159 17510 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:40.578255 17510 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:40.579144 17510 tablet_bootstrap.cc:492] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:40.579802 17510 ts_tablet_manager.cc:1403] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.008s
I20260204 08:58:40.582100 17510 raft_consensus.cc:359] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:40.582717 17510 raft_consensus.cc:740] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:40.583281 17510 consensus_queue.cc:260] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:40.585597 17510 ts_tablet_manager.cc:1434] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:58:40.587007 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-801ee654117f4d37b4ad0c66b46fd4e4 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:40.587391 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-801ee654117f4d37b4ad0c66b46fd4e4 on tablet 801ee654117f4d37b4ad0c66b46fd4e4 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:40.845917 17253 raft_consensus.cc:1217] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:40.918202 17253 raft_consensus.cc:1217] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:40.941232 17253 raft_consensus.cc:1217] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:40.953171 17253 raft_consensus.cc:1217] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:41.318511 17500 raft_consensus.cc:1064] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:41.320843 17500 consensus_queue.cc:237] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:41.326730 17252 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.327392 16680 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.328356 16603 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.328804 17518 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.330832 17518 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.332034 17500 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.351609 17518 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.353956 16603 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.354215 17252 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.364164 16680 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.375857 16427 catalog_manager.cc:5654] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.389917 17519 raft_consensus.cc:1064] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:41.392362 17519 consensus_queue.cc:237] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:41.403208 16531 consensus_queue.cc:237] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:41.405391 16603 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.405866 17252 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.405937 16526 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.407179 17482 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.408108 17481 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.410444 17519 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.417423 17252 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:41.418119 17501 raft_consensus.cc:1064] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:41.420499 17501 consensus_queue.cc:237] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:41.422806 17500 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:41.429816 17518 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.430728 17252 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.433736 16600 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:41.437965 17500 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:41.441119 17481 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.449261 16600 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.455578 16426 catalog_manager.cc:5654] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.476897 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet b4a8f14fd5174a4d98b1849c67325173 with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:41.478448 17252 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.481452 16426 catalog_manager.cc:5654] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:41.490063 17540 tablet_replica.cc:333] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:41.492583 17540 raft_consensus.cc:2243] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:41.493378 17540 raft_consensus.cc:2272] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:58:41.498104 16498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33281, user_credentials={real_user=slave}} blocked reactor thread for 50182.3us
I20260204 08:58:41.502064 16680 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.501432 16524 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.503736 17538 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:41.506929 16603 raft_consensus.cc:2955] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.514254 17252 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.515435 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet b4a8f14fd5174a4d98b1849c67325173 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:41.517675 16600 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.521510 17531 raft_consensus.cc:1064] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:41.521379 17533 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.522264 17518 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.524489 17531 consensus_queue.cc:237] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:41.530390 17540 ts_tablet_manager.cc:1916] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:41.543983 17253 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.546272 17533 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:41.556762 16678 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:41.558961 17534 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:41.575836 17531 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.585608 17253 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.586033 16603 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260204 08:58:41.593446 16646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 66344.7us
I20260204 08:58:41.594116 17535 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:41.599853 16598 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.601744 16430 catalog_manager.cc:5654] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.623121 16673 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.636595 17540 ts_tablet_manager.cc:1929] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:41.637104 17540 log.cc:1199] T b4a8f14fd5174a4d98b1849c67325173 P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/b4a8f14fd5174a4d98b1849c67325173
I20260204 08:58:41.642119 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet b4a8f14fd5174a4d98b1849c67325173 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:41.694458 17500 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.700253 16600 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.712795 16430 catalog_manager.cc:5654] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:41.714679 17252 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.730453 16526 consensus_queue.cc:237] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:41.737809 16680 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.742924 17252 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:41.748592 17537 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:58:41.756861 16673 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:41.760466 17535 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:41.761849 17535 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.766543 17252 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.770063 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d7f0ef5121b748d18bbd7783a318fbc7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:41.772131 16673 raft_consensus.cc:2955] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.779022 16430 catalog_manager.cc:5654] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:41.791083 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet d7f0ef5121b748d18bbd7783a318fbc7 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:41.796209 17550 tablet_replica.cc:333] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:41.797793 17550 raft_consensus.cc:2243] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:41.799377 17550 raft_consensus.cc:2272] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:41.803124 17550 ts_tablet_manager.cc:1916] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:41.815853 17550 ts_tablet_manager.cc:1929] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:41.816231 17550 log.cc:1199] T d7f0ef5121b748d18bbd7783a318fbc7 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/d7f0ef5121b748d18bbd7783a318fbc7
I20260204 08:58:41.817770 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet d7f0ef5121b748d18bbd7783a318fbc7 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:41.898499 16674 consensus_queue.cc:237] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:41.902472 16600 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:41.902556 17252 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:41.903733 17542 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:41.906996 17481 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:41.911677 17542 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.913062 16600 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.921263 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet af129226cb2f41479ef5eb75771c860b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:41.920867 17252 raft_consensus.cc:2955] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:41.931614 16426 catalog_manager.cc:5654] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:41.944789 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet af129226cb2f41479ef5eb75771c860b with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:41.946830 17551 tablet_replica.cc:333] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:41.947836 17551 raft_consensus.cc:2243] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:41.948390 17551 raft_consensus.cc:2272] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:41.952476 17551 ts_tablet_manager.cc:1916] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:41.965035 17551 ts_tablet_manager.cc:1929] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:41.965339 17551 log.cc:1199] T af129226cb2f41479ef5eb75771c860b P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/af129226cb2f41479ef5eb75771c860b
I20260204 08:58:41.966648 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet af129226cb2f41479ef5eb75771c860b (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:42.096753 16531 consensus_queue.cc:237] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:42.101235 17252 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:42.101239 16600 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:42.103551 17500 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:42.105732 17535 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:42.111894 17537 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:42.114691 16600 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:42.114993 17252 raft_consensus.cc:2955] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:42.125319 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 801ee654117f4d37b4ad0c66b46fd4e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:42.126416 16430 catalog_manager.cc:5654] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:42.141155 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 801ee654117f4d37b4ad0c66b46fd4e4 with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:42.152287 17552 tablet_replica.cc:333] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:42.153151 17552 raft_consensus.cc:2243] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:42.153656 17552 raft_consensus.cc:2272] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:42.155817 17552 ts_tablet_manager.cc:1916] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:42.166618 17552 ts_tablet_manager.cc:1929] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:42.167083 17552 log.cc:1199] T 801ee654117f4d37b4ad0c66b46fd4e4 P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/801ee654117f4d37b4ad0c66b46fd4e4
I20260204 08:58:42.168566 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 801ee654117f4d37b4ad0c66b46fd4e4 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
W20260204 08:58:43.193614 17519 consensus_queue.cc:1175] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35380a227e2c4fa4a063d4fd67c30b53" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260204 08:58:43.194510 16673 consensus_queue.cc:237] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
W20260204 08:58:43.201030 16647 consensus_peers.cc:597] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e3200a486ed4e50b8cd3fbace254888. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:43.201033 16606 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:43.203722 16526 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:43.204120 17519 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:43.206190 17536 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:43.212976 16606 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.211395 17519 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.220309 16526 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.233438 16674 consensus_queue.cc:237] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.235257 16426 catalog_manager.cc:5654] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.243206 16531 raft_consensus.cc:1275] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:43.246551 17519 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:43.251685 16606 raft_consensus.cc:1275] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:43.254325 16647 consensus_peers.cc:597] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6a3887aa0f64b1a8d49dc7e0e061459. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:43.255213 17519 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:43.263721 17519 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.265349 16531 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.268240 16606 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.292850 16531 consensus_queue.cc:237] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.293948 16430 catalog_manager.cc:5654] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
W20260204 08:58:43.300848 16498 consensus_peers.cc:597] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72c4736a5d244206a366cb1166df369e. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:43.302469 16674 raft_consensus.cc:1275] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:43.304060 16606 raft_consensus.cc:1275] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:43.304028 17555 consensus_queue.cc:1048] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:43.305297 17534 consensus_queue.cc:1048] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:43.312275 17537 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.313834 16674 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.322029 16606 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.326880 16598 consensus_queue.cc:237] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.330339 16426 catalog_manager.cc:5654] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260204 08:58:43.347048 16573 consensus_peers.cc:597] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c2c27e6ec9949a0ae96e967adf3ffd9. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:43.353956 16674 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:43.355090 16531 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:43.356510 17553 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:43.357636 17549 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:43.367908 17553 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.369119 16674 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.372870 16531 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.385982 16426 catalog_manager.cc:5654] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:43.713584 17575 ts_tablet_manager.cc:933] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:43.716574 17575 tablet_copy_client.cc:323] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:43.721501 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 6e3200a486ed4e50b8cd3fbace254888 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:43.722028 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 6e3200a486ed4e50b8cd3fbace254888 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-6e3200a486ed4e50b8cd3fbace254888
I20260204 08:58:43.731997 16691 tablet_copy_source_session.cc:215] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:43.736099 17575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3200a486ed4e50b8cd3fbace254888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:43.736667 17577 ts_tablet_manager.cc:933] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:43.738787 17577 tablet_copy_client.cc:323] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:43.740937 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:43.741442 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-9c2c27e6ec9949a0ae96e967adf3ffd9
I20260204 08:58:43.748741 16617 tablet_copy_source_session.cc:215] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:43.751766 17577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:43.752930 17575 tablet_copy_client.cc:806] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:43.753542 17575 tablet_copy_client.cc:670] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:43.757540 17575 tablet_copy_client.cc:538] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:43.776690 17577 tablet_copy_client.cc:806] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:43.777266 17577 tablet_copy_client.cc:670] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:43.780635 17579 ts_tablet_manager.cc:933] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:43.786124 17577 tablet_copy_client.cc:538] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:43.786170 17575 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:43.796725 17577 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:43.808615 17579 tablet_copy_client.cc:323] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:43.810022 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 72c4736a5d244206a366cb1166df369e from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:43.810437 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 72c4736a5d244206a366cb1166df369e from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-72c4736a5d244206a366cb1166df369e
I20260204 08:58:43.816113 17575 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:43.817200 17575 tablet_bootstrap.cc:492] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:43.818004 17575 ts_tablet_manager.cc:1403] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.032s user 0.017s sys 0.008s
I20260204 08:58:43.818748 16541 tablet_copy_source_session.cc:215] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:43.823721 17575 raft_consensus.cc:359] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.824644 17575 raft_consensus.cc:740] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:43.824985 17579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c4736a5d244206a366cb1166df369e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:43.825322 17575 consensus_queue.cc:260] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.841495 17577 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:43.850455 17577 tablet_bootstrap.cc:492] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:43.851193 17577 ts_tablet_manager.cc:1403] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.055s user 0.016s sys 0.011s
I20260204 08:58:43.857816 17585 ts_tablet_manager.cc:933] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:43.858572 17575 ts_tablet_manager.cc:1434] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.040s user 0.008s sys 0.017s
I20260204 08:58:43.861860 17585 tablet_copy_client.cc:323] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:43.861483 17577 raft_consensus.cc:359] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.862511 17577 raft_consensus.cc:740] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:43.863188 17577 consensus_queue.cc:260] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.864244 16690 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-6e3200a486ed4e50b8cd3fbace254888 received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:43.864751 16690 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-6e3200a486ed4e50b8cd3fbace254888 on tablet 6e3200a486ed4e50b8cd3fbace254888 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:43.865732 17577 ts_tablet_manager.cc:1434] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260204 08:58:43.864231 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet e6a3887aa0f64b1a8d49dc7e0e061459 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:43.867238 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet e6a3887aa0f64b1a8d49dc7e0e061459 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-e6a3887aa0f64b1a8d49dc7e0e061459
I20260204 08:58:43.870011 17579 tablet_copy_client.cc:806] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:43.870100 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-9c2c27e6ec9949a0ae96e967adf3ffd9 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:43.870594 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-9c2c27e6ec9949a0ae96e967adf3ffd9 on tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:43.870692 17579 tablet_copy_client.cc:670] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:43.878118 16691 tablet_copy_source_session.cc:215] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:43.880666 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a3887aa0f64b1a8d49dc7e0e061459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:43.881510 17579 tablet_copy_client.cc:538] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:43.892915 17579 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:43.896739 17585 tablet_copy_client.cc:806] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:43.897488 17585 tablet_copy_client.cc:670] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:43.901610 17585 tablet_copy_client.cc:538] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:43.907840 17585 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:43.925367 17579 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:43.926251 17579 tablet_bootstrap.cc:492] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:43.926941 17579 ts_tablet_manager.cc:1403] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.034s user 0.021s sys 0.000s
I20260204 08:58:43.930750 17579 raft_consensus.cc:359] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.931516 17579 raft_consensus.cc:740] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:43.932044 17585 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:43.932184 17579 consensus_queue.cc:260] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.932933 17585 tablet_bootstrap.cc:492] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:43.933606 17585 ts_tablet_manager.cc:1403] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.026s user 0.020s sys 0.004s
I20260204 08:58:43.934618 17579 ts_tablet_manager.cc:1434] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260204 08:58:43.936192 17585 raft_consensus.cc:359] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.936760 17585 raft_consensus.cc:740] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:43.937343 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-72c4736a5d244206a366cb1166df369e received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:43.937224 17585 consensus_queue.cc:260] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:43.937703 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-72c4736a5d244206a366cb1166df369e on tablet 72c4736a5d244206a366cb1166df369e with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:43.939236 17585 ts_tablet_manager.cc:1434] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:58:43.941401 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-e6a3887aa0f64b1a8d49dc7e0e061459 received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:43.941771 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-e6a3887aa0f64b1a8d49dc7e0e061459 on tablet e6a3887aa0f64b1a8d49dc7e0e061459 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:44.119539 17253 raft_consensus.cc:1217] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:44.147060 17253 raft_consensus.cc:1217] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:44.344170 17253 raft_consensus.cc:1217] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:44.393492 17253 raft_consensus.cc:1217] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:44.521003 17519 raft_consensus.cc:1064] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:44.523240 17519 consensus_queue.cc:237] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:44.533953 17253 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.534417 16531 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.535050 16603 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.536340 17519 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:44.537130 17580 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:44.537859 17590 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:44.550614 17519 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.552672 16598 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.560056 17252 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.565492 16526 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.570657 16426 catalog_manager.cc:5654] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.609758 16673 consensus_queue.cc:237] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:44.614126 17252 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:44.614383 16526 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:44.615362 17519 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:44.616591 17519 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:44.622228 17580 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.625620 16526 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.626716 17252 raft_consensus.cc:2955] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.632869 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 6e3200a486ed4e50b8cd3fbace254888 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:44.638918 17554 raft_consensus.cc:1064] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:44.641139 17554 consensus_queue.cc:237] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:44.642573 16430 catalog_manager.cc:5654] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.656703 17253 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.657867 17601 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:44.658938 16673 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.660197 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e3200a486ed4e50b8cd3fbace254888 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:44.661815 16531 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.661839 17602 tablet_replica.cc:333] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:44.663609 17602 raft_consensus.cc:2243] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:44.664361 17602 raft_consensus.cc:2272] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:44.666505 17554 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:44.667527 17600 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:44.668946 17602 ts_tablet_manager.cc:1916] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:44.691278 17554 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.692456 17253 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.707554 17602 ts_tablet_manager.cc:1929] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:44.708112 17602 log.cc:1199] T 6e3200a486ed4e50b8cd3fbace254888 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/6e3200a486ed4e50b8cd3fbace254888
I20260204 08:58:44.711220 16673 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.712035 16531 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.718335 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 6e3200a486ed4e50b8cd3fbace254888 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:44.721798 16429 catalog_manager.cc:5654] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.743017 16598 consensus_queue.cc:237] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:44.748059 17253 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:44.749572 17600 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:44.750036 16673 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:44.751541 17600 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:44.759331 17554 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.763307 17253 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.770720 16680 raft_consensus.cc:2955] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.776008 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:44.790933 16427 catalog_manager.cc:5654] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:44.802076 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:44.803951 17607 tablet_replica.cc:333] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:44.804981 17607 raft_consensus.cc:2243] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:44.806149 17607 raft_consensus.cc:2272] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:44.814265 17607 ts_tablet_manager.cc:1916] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:44.828783 17607 ts_tablet_manager.cc:1929] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:44.829100 17607 log.cc:1199] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/9c2c27e6ec9949a0ae96e967adf3ffd9
I20260204 08:58:44.830444 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 9c2c27e6ec9949a0ae96e967adf3ffd9 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:44.872079 17580 raft_consensus.cc:1064] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:44.874379 17580 consensus_queue.cc:237] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:44.880229 16603 raft_consensus.cc:1275] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.880227 17253 raft_consensus.cc:1275] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.880432 16531 raft_consensus.cc:1275] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.881675 17580 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:44.882467 17536 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:44.883224 17590 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:44.893668 17580 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.895574 16531 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.901593 17253 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.912320 16429 catalog_manager.cc:5654] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.914119 16603 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.934216 16680 consensus_queue.cc:237] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:44.939289 17253 raft_consensus.cc:1275] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:44.939677 16603 raft_consensus.cc:1275] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:44.940780 17536 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:44.942688 17519 consensus_queue.cc:1048] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:44.948504 17589 raft_consensus.cc:1064] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:44.949944 17590 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.951371 17589 consensus_queue.cc:237] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:44.953877 17252 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.955273 16603 raft_consensus.cc:2955] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.959730 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet e6a3887aa0f64b1a8d49dc7e0e061459 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:44.983093 16673 raft_consensus.cc:1275] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.970316 16429 catalog_manager.cc:5654] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:44.984577 17614 consensus_queue.cc:1048] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:44.996220 17252 raft_consensus.cc:1275] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.996639 16603 raft_consensus.cc:1275] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:44.999548 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet e6a3887aa0f64b1a8d49dc7e0e061459 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:45.000420 17607 tablet_replica.cc:333] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:45.001024 17589 consensus_queue.cc:1048] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:45.001407 17607 raft_consensus.cc:2243] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:45.002187 17607 raft_consensus.cc:2272] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:45.002411 17589 consensus_queue.cc:1048] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:45.009383 17607 ts_tablet_manager.cc:1916] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:45.031744 17607 ts_tablet_manager.cc:1929] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:45.028203 17589 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.032265 17607 log.cc:1199] T e6a3887aa0f64b1a8d49dc7e0e061459 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/e6a3887aa0f64b1a8d49dc7e0e061459
I20260204 08:58:45.034160 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet e6a3887aa0f64b1a8d49dc7e0e061459 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:45.035080 17252 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.038147 16603 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.044622 16673 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.050652 16429 catalog_manager.cc:5654] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.075289 16524 consensus_queue.cc:237] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:45.082729 17252 raft_consensus.cc:1275] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:45.084218 16598 raft_consensus.cc:1275] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:45.084825 17614 consensus_queue.cc:1048] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:45.086791 17614 consensus_queue.cc:1048] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:45.093879 17614 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.099349 17253 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.099833 16598 raft_consensus.cc:2955] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.104595 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 72c4736a5d244206a366cb1166df369e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:45.113070 16429 catalog_manager.cc:5654] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:45.123378 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 72c4736a5d244206a366cb1166df369e with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:45.125324 17619 tablet_replica.cc:333] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:45.126811 17619 raft_consensus.cc:2243] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:45.128078 17619 raft_consensus.cc:2272] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:45.130649 17619 ts_tablet_manager.cc:1916] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:45.141289 17619 ts_tablet_manager.cc:1929] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:45.141551 17619 log.cc:1199] T 72c4736a5d244206a366cb1166df369e P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/72c4736a5d244206a366cb1166df369e
I20260204 08:58:45.143112 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 72c4736a5d244206a366cb1166df369e (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:46.180174 16680 consensus_queue.cc:237] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
W20260204 08:58:46.186836 16647 consensus_peers.cc:597] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 795715e8aaa1450e811ecebf022fd69b. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:46.187513 16603 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:46.188036 16524 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:46.188663 17536 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:46.189499 17519 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:46.196254 17536 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.197896 16598 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.199820 16531 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.211253 16598 consensus_queue.cc:237] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.214366 16429 catalog_manager.cc:5654] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:46.240031 16680 raft_consensus.cc:1275] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:46.240937 16573 consensus_peers.cc:597] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c77c8d18f5274899a308f09e7aa99de3. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:46.241716 17629 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:46.242142 16531 raft_consensus.cc:1275] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:46.244194 17606 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:46.249564 17606 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.255973 16680 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.267027 16531 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.271721 16427 catalog_manager.cc:5654] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:46.272470 16673 consensus_queue.cc:237] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
W20260204 08:58:46.289880 16647 consensus_peers.cc:597] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20fa246d3c414fa0b616da38a625bdfe. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:46.290022 16598 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:46.291059 16531 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:46.291201 17519 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:46.293789 17625 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:46.308681 17536 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.317649 16524 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.319443 16598 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.326968 16531 consensus_queue.cc:237] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.330802 16430 catalog_manager.cc:5654] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:46.341320 16603 raft_consensus.cc:1275] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:46.342496 16673 raft_consensus.cc:1275] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:46.342370 17621 consensus_queue.cc:1048] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:46.343775 17614 consensus_queue.cc:1048] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:58:46.346488 16498 consensus_peers.cc:597] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d0dd5730ea04490876711f04afa95e5. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:46.354583 17614 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.356933 16674 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.359751 16603 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.374219 16427 catalog_manager.cc:5654] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:46.602689 17641 ts_tablet_manager.cc:933] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:46.604959 17641 tablet_copy_client.cc:323] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:46.606293 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 795715e8aaa1450e811ecebf022fd69b from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:46.606724 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 795715e8aaa1450e811ecebf022fd69b from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-795715e8aaa1450e811ecebf022fd69b
I20260204 08:58:46.612401 16691 tablet_copy_source_session.cc:215] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:46.614800 17641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795715e8aaa1450e811ecebf022fd69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:46.626360 17641 tablet_copy_client.cc:806] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:46.626828 17641 tablet_copy_client.cc:670] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:46.629643 17641 tablet_copy_client.cc:538] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:46.639405 17641 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:46.658429 17641 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:46.659337 17641 tablet_bootstrap.cc:492] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:46.660007 17641 ts_tablet_manager.cc:1403] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.021s user 0.021s sys 0.000s
I20260204 08:58:46.662315 17641 raft_consensus.cc:359] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.662869 17641 raft_consensus.cc:740] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:46.663316 17641 consensus_queue.cc:260] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.666591 17641 ts_tablet_manager.cc:1434] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260204 08:58:46.668376 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-795715e8aaa1450e811ecebf022fd69b received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:46.668761 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-795715e8aaa1450e811ecebf022fd69b on tablet 795715e8aaa1450e811ecebf022fd69b with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:46.787004 17641 ts_tablet_manager.cc:933] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:46.788381 17645 ts_tablet_manager.cc:933] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:46.795435 17645 tablet_copy_client.cc:323] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:46.795958 17641 tablet_copy_client.cc:323] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:46.796885 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet c77c8d18f5274899a308f09e7aa99de3 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:46.797297 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet c77c8d18f5274899a308f09e7aa99de3 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-c77c8d18f5274899a308f09e7aa99de3
I20260204 08:58:46.798050 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 20fa246d3c414fa0b616da38a625bdfe from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:46.798553 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 20fa246d3c414fa0b616da38a625bdfe from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-20fa246d3c414fa0b616da38a625bdfe
I20260204 08:58:46.803296 16617 tablet_copy_source_session.cc:215] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:46.805184 16691 tablet_copy_source_session.cc:215] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:46.805869 17645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77c8d18f5274899a308f09e7aa99de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:46.807493 17641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fa246d3c414fa0b616da38a625bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:46.819451 17645 tablet_copy_client.cc:806] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:46.820256 17645 tablet_copy_client.cc:670] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:46.823370 17645 tablet_copy_client.cc:538] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:46.826961 17641 tablet_copy_client.cc:806] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:46.828385 17641 tablet_copy_client.cc:670] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:46.831494 17645 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:46.834816 17648 ts_tablet_manager.cc:933] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:46.838585 17641 tablet_copy_client.cc:538] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:46.847999 17641 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:46.870507 17648 tablet_copy_client.cc:323] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:46.872026 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 4d0dd5730ea04490876711f04afa95e5 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:46.872416 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 4d0dd5730ea04490876711f04afa95e5 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-4d0dd5730ea04490876711f04afa95e5
I20260204 08:58:46.877084 17641 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:46.878037 17641 tablet_bootstrap.cc:492] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:46.878659 17641 ts_tablet_manager.cc:1403] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.008s
I20260204 08:58:46.879019 16541 tablet_copy_source_session.cc:215] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:46.881285 17645 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:46.881256 17641 raft_consensus.cc:359] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.882556 17645 tablet_bootstrap.cc:492] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:46.882210 17641 raft_consensus.cc:740] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:46.883389 17648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0dd5730ea04490876711f04afa95e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:46.884142 17645 ts_tablet_manager.cc:1403] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.053s user 0.031s sys 0.016s
I20260204 08:58:46.884123 17641 consensus_queue.cc:260] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.886917 17641 ts_tablet_manager.cc:1434] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.008s user 0.002s sys 0.003s
I20260204 08:58:46.888309 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-20fa246d3c414fa0b616da38a625bdfe received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:46.888688 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-20fa246d3c414fa0b616da38a625bdfe on tablet 20fa246d3c414fa0b616da38a625bdfe with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:46.890574 17645 raft_consensus.cc:359] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.891381 17645 raft_consensus.cc:740] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:46.892839 17645 consensus_queue.cc:260] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.894876 17645 ts_tablet_manager.cc:1434] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.010s user 0.001s sys 0.004s
I20260204 08:58:46.896296 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-c77c8d18f5274899a308f09e7aa99de3 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:46.896668 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-c77c8d18f5274899a308f09e7aa99de3 on tablet c77c8d18f5274899a308f09e7aa99de3 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:46.905515 17648 tablet_copy_client.cc:806] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:46.906054 17648 tablet_copy_client.cc:670] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:46.919757 17648 tablet_copy_client.cc:538] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:46.927798 17648 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:46.946074 17648 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:46.946780 17648 tablet_bootstrap.cc:492] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:46.947301 17648 ts_tablet_manager.cc:1403] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.008s
I20260204 08:58:46.949909 17648 raft_consensus.cc:359] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.950843 17648 raft_consensus.cc:740] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:46.951407 17648 consensus_queue.cc:260] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:46.953750 17648 ts_tablet_manager.cc:1434] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260204 08:58:46.955250 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-4d0dd5730ea04490876711f04afa95e5 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:46.955559 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-4d0dd5730ea04490876711f04afa95e5 on tablet 4d0dd5730ea04490876711f04afa95e5 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:47.129508 17253 raft_consensus.cc:1217] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:47.229321 17253 raft_consensus.cc:1217] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:47.234803 17253 raft_consensus.cc:1217] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:47.335187 17253 raft_consensus.cc:1217] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:47.603284 17519 raft_consensus.cc:1064] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:47.605063 17519 consensus_queue.cc:237] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:47.611362 17252 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.612527 16603 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.613634 17657 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.614806 17536 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.617312 16531 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.618428 17536 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.626188 17536 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.627285 17253 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.632594 16531 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.645483 16603 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.646003 16427 catalog_manager.cc:5654] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.681043 16674 consensus_queue.cc:237] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:47.685159 16531 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:47.686494 17519 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:47.689230 17253 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:47.690577 17519 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:47.692339 17536 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.696395 16531 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.701263 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 795715e8aaa1450e811ecebf022fd69b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:47.709520 16429 catalog_manager.cc:5654] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:47.716636 17253 raft_consensus.cc:2955] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.722726 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 795715e8aaa1450e811ecebf022fd69b with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:47.747581 17665 tablet_replica.cc:333] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:47.748667 17665 raft_consensus.cc:2243] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:47.749471 17665 raft_consensus.cc:2272] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:47.752579 17665 ts_tablet_manager.cc:1916] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:47.765823 17665 ts_tablet_manager.cc:1929] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:47.766296 17665 log.cc:1199] T 795715e8aaa1450e811ecebf022fd69b P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/795715e8aaa1450e811ecebf022fd69b
I20260204 08:58:47.767803 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 795715e8aaa1450e811ecebf022fd69b (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:47.799618 17652 raft_consensus.cc:1064] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:47.801829 17652 consensus_queue.cc:237] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:47.807374 17253 raft_consensus.cc:1275] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.808696 17614 consensus_queue.cc:1048] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.809111 16680 raft_consensus.cc:1275] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.810747 17614 consensus_queue.cc:1048] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.814200 16598 raft_consensus.cc:1275] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.815550 17667 consensus_queue.cc:1048] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.823586 17536 raft_consensus.cc:1064] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:47.825717 17536 consensus_queue.cc:237] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:47.825325 17652 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.844272 17253 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.846418 17536 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.846946 16598 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.848526 16531 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.849826 17519 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.850546 17536 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:47.853776 16598 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.854099 17252 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.849171 16430 catalog_manager.cc:5654] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:47.879511 16674 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.949703 17536 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.953217 17253 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.958628 16606 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.964601 17620 raft_consensus.cc:1064] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:47.966852 17620 consensus_queue.cc:237] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:47.978457 16429 catalog_manager.cc:5654] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.989060 16525 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:47.993088 16526 consensus_queue.cc:237] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:47.997769 17253 raft_consensus.cc:1275] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.997733 16674 raft_consensus.cc:1275] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:47.999246 17679 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:48.002602 17620 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:48.005235 16673 raft_consensus.cc:1275] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:48.008061 17614 consensus_queue.cc:1048] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:48.020742 17671 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.024278 17252 raft_consensus.cc:1275] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:48.025738 16525 raft_consensus.cc:1275] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:48.027108 17679 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:48.027485 16673 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.030542 17652 consensus_queue.cc:1048] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:48.032209 17606 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.035878 17251 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.038777 16674 consensus_queue.cc:237] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:48.039093 17253 raft_consensus.cc:2955] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.044273 16606 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:48.043079 16674 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.045593 17654 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:48.044641 17252 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:48.051913 17654 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:48.051482 16430 catalog_manager.cc:5654] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.062889 16429 catalog_manager.cc:5654] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.067284 16606 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.069938 17251 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.064215 17677 raft_consensus.cc:2955] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.080422 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4d0dd5730ea04490876711f04afa95e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:48.086282 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d0dd5730ea04490876711f04afa95e5 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:48.087149 17665 tablet_replica.cc:333] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:48.088008 17665 raft_consensus.cc:2243] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:48.088711 17665 raft_consensus.cc:2272] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:48.093807 17665 ts_tablet_manager.cc:1916] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:48.094543 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 20fa246d3c414fa0b616da38a625bdfe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:48.103881 16426 catalog_manager.cc:5654] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.113381 16526 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.128206 17665 ts_tablet_manager.cc:1929] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:48.128646 17665 log.cc:1199] T 4d0dd5730ea04490876711f04afa95e5 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/4d0dd5730ea04490876711f04afa95e5
I20260204 08:58:48.129746 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 4d0dd5730ea04490876711f04afa95e5 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:48.138365 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 20fa246d3c414fa0b616da38a625bdfe with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:48.139977 17683 tablet_replica.cc:333] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:48.142756 17683 raft_consensus.cc:2243] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:48.144155 17683 raft_consensus.cc:2272] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:48.146940 16603 consensus_queue.cc:237] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:48.153184 17251 raft_consensus.cc:1275] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:48.155221 17683 ts_tablet_manager.cc:1916] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:48.157335 17620 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:48.161064 16526 raft_consensus.cc:1275] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:48.164928 17655 consensus_queue.cc:1048] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:48.169950 17620 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.175937 17683 ts_tablet_manager.cc:1929] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:48.176401 17683 log.cc:1199] T 20fa246d3c414fa0b616da38a625bdfe P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/20fa246d3c414fa0b616da38a625bdfe
I20260204 08:58:48.176795 17252 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.179989 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 20fa246d3c414fa0b616da38a625bdfe (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:48.181874 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c77c8d18f5274899a308f09e7aa99de3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:48.188647 16525 raft_consensus.cc:2955] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.192560 16426 catalog_manager.cc:5654] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:48.200907 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet c77c8d18f5274899a308f09e7aa99de3 with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:48.205013 17684 tablet_replica.cc:333] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:48.205722 17684 raft_consensus.cc:2243] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:48.206351 17684 raft_consensus.cc:2272] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:48.211120 17684 ts_tablet_manager.cc:1916] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:48.222496 17684 ts_tablet_manager.cc:1929] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:48.222879 17684 log.cc:1199] T c77c8d18f5274899a308f09e7aa99de3 P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/c77c8d18f5274899a308f09e7aa99de3
I20260204 08:58:48.224305 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet c77c8d18f5274899a308f09e7aa99de3 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:49.258419 16598 consensus_queue.cc:237] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:49.264457 16673 raft_consensus.cc:1275] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:49.265492 16526 raft_consensus.cc:1275] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:49.266112 16573 consensus_peers.cc:597] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 796b324679b4492db7f68598b0a2d4e2. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:49.266021 17655 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:49.267299 17620 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:49.268546 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:49.277957 17620 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.286216 16526 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.291816 16674 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.296974 16673 consensus_queue.cc:237] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:49.330974 16598 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:49.332046 16525 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:49.332530 17687 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260204 08:58:49.334048 16647 consensus_peers.cc:597] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68912efba25745d9ba6be48c71f92a38. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:49.325460 16427 catalog_manager.cc:5654] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.334748 17687 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:49.354777 16526 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.358249 16598 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.351717 17677 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.378507 16531 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0d2622edd6954367a260d3600443dd26"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:49.379300 16531 raft_consensus.cc:606] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:49.383574 16598 consensus_queue.cc:237] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
W20260204 08:58:49.400652 16573 consensus_peers.cc:597] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4dc53e7c74664efe82fc5edb6dfca943. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:49.401002 16674 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:49.402838 17655 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:49.403798 16526 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:49.408330 17692 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:49.409686 16673 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:49.410310 16673 raft_consensus.cc:606] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:49.413738 16531 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:49.414299 16531 raft_consensus.cc:606] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:49.424327 16526 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:49.424916 16526 raft_consensus.cc:606] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:49.430263 17620 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.440578 16426 catalog_manager.cc:5654] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.445722 16674 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.453461 16526 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.466939 16603 consensus_queue.cc:237] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:49.466879 16426 catalog_manager.cc:5654] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:49.483979 16674 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260204 08:58:49.485044 16526 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260204 08:58:49.487640 16573 consensus_peers.cc:597] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3326e90f03344694ace417ed6615d3fa. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:49.488490 17620 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:49.488457 16598 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:49.489539 16598 raft_consensus.cc:606] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:49.492303 17620 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:49.494587 16526 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b4a8f14fd5174a4d98b1849c67325173"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:49.495203 16526 raft_consensus.cc:606] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:49.498060 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260204 08:58:49.499640 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:49.500599 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:49.504848 17655 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.507166 16674 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.510880 16531 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.523098 16429 catalog_manager.cc:5654] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 3, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:49.527727 17652 raft_consensus.cc:993] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:49.528358 17652 raft_consensus.cc:1081] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:49.530345 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b4a8f14fd5174a4d98b1849c67325173"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41584
I20260204 08:58:49.530874 17252 raft_consensus.cc:493] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:49.531177 17252 raft_consensus.cc:3060] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.540755 17671 raft_consensus.cc:993] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:49.541219 17671 raft_consensus.cc:1081] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:49.546213 17251 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41584
I20260204 08:58:49.546698 17251 raft_consensus.cc:493] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:49.547030 17251 raft_consensus.cc:3060] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.553249 17252 raft_consensus.cc:515] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.556314 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8f14fd5174a4d98b1849c67325173" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:49.556928 16526 raft_consensus.cc:3055] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:49.557179 16526 raft_consensus.cc:740] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:49.557849 16526 consensus_queue.cc:260] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.555872 17252 leader_election.cc:290] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:49.558801 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a8f14fd5174a4d98b1849c67325173" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:49.559307 16603 raft_consensus.cc:3060] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.568244 16526 raft_consensus.cc:3060] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.575574 16603 raft_consensus.cc:2468] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:49.577415 16526 raft_consensus.cc:2468] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:49.582366 17219 leader_election.cc:304] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:49.569720 17251 raft_consensus.cc:515] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.588104 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:49.588663 16674 raft_consensus.cc:3060] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.590113 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "810a9a6b2d154b6d9a7b8c4d2db5f692" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:49.591147 16531 raft_consensus.cc:3055] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:49.591733 16531 raft_consensus.cc:740] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:49.594422 16531 consensus_queue.cc:260] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.595060 16674 raft_consensus.cc:2468] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:49.596297 17218 leader_election.cc:304] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:49.596771 16531 raft_consensus.cc:3060] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.606638 17251 leader_election.cc:290] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:49.609591 16531 raft_consensus.cc:2468] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:49.596455 17712 raft_consensus.cc:2804] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:49.611948 17713 raft_consensus.cc:2804] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:49.615116 17712 raft_consensus.cc:697] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:49.616067 17712 consensus_queue.cc:237] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.620445 17713 raft_consensus.cc:697] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:49.622648 17713 consensus_queue.cc:237] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.627110 16426 catalog_manager.cc:5654] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:49.632190 17654 raft_consensus.cc:993] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:49.632618 17654 raft_consensus.cc:1081] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:49.637064 17251 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41592
I20260204 08:58:49.637593 17251 raft_consensus.cc:493] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:49.637970 17251 raft_consensus.cc:3060] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.640779 16426 catalog_manager.cc:5654] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:49.649021 17251 raft_consensus.cc:515] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.651294 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:49.651842 16531 raft_consensus.cc:3060] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.652853 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e3200a486ed4e50b8cd3fbace254888" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:49.653323 16674 raft_consensus.cc:3055] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:49.653631 16674 raft_consensus.cc:740] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:49.654212 16674 consensus_queue.cc:260] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.655015 16674 raft_consensus.cc:3060] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.655754 17251 leader_election.cc:290] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:49.657111 16531 raft_consensus.cc:2468] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:49.658154 17218 leader_election.cc:304] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 6e58e6edfb3b43b1b5378f9e9a26e842; no voters:
I20260204 08:58:49.658774 17713 raft_consensus.cc:2804] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:49.659216 17713 raft_consensus.cc:697] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:49.660629 17713 consensus_queue.cc:237] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.663156 16674 raft_consensus.cc:2468] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:49.669142 16426 catalog_manager.cc:5654] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:49.839897 17719 ts_tablet_manager.cc:933] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:49.840586 17655 raft_consensus.cc:993] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:49.841037 17620 raft_consensus.cc:1081] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:49.842419 16526 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55724
I20260204 08:58:49.842823 16526 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:49.843104 16526 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:49.848330 17719 tablet_copy_client.cc:323] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:49.851136 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 796b324679b4492db7f68598b0a2d4e2 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:49.851305 16526 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:49.851730 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 796b324679b4492db7f68598b0a2d4e2 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-796b324679b4492db7f68598b0a2d4e2
I20260204 08:58:49.853296 16526 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 3 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:49.854813 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:49.854900 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:49.855289 16673 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:49.855464 16603 raft_consensus.cc:3055] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:49.855852 16603 raft_consensus.cc:740] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:49.856573 16603 consensus_queue.cc:260] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:49.857692 16603 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:49.859437 16617 tablet_copy_source_session.cc:215] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:49.860284 16673 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 3.
I20260204 08:58:49.861295 16497 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:49.862653 17711 raft_consensus.cc:2804] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:49.863066 17711 raft_consensus.cc:697] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:49.863962 16603 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 3.
I20260204 08:58:49.864379 17719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796b324679b4492db7f68598b0a2d4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:49.863926 17711 consensus_queue.cc:237] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:49.882119 17719 tablet_copy_client.cc:806] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:49.882805 17719 tablet_copy_client.cc:670] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:49.895903 17719 tablet_copy_client.cc:538] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:49.895521 16426 catalog_manager.cc:5654] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 2 to 3, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 3 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:49.910220 17719 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:49.936484 17688 raft_consensus.cc:993] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:49.936755 17671 raft_consensus.cc:993] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:49.936978 17688 raft_consensus.cc:1081] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:49.937214 17671 raft_consensus.cc:1081] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:49.938773 17719 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:49.938702 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41584
I20260204 08:58:49.939884 17252 raft_consensus.cc:493] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:49.940214 17252 raft_consensus.cc:3060] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.941354 17719 tablet_bootstrap.cc:492] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:49.941536 16598 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0d2622edd6954367a260d3600443dd26"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57790
I20260204 08:58:49.942140 17719 ts_tablet_manager.cc:1403] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.032s user 0.024s sys 0.005s
I20260204 08:58:49.942090 16598 raft_consensus.cc:493] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:49.945032 16598 raft_consensus.cc:3060] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.945640 17719 raft_consensus.cc:359] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:49.946488 17719 raft_consensus.cc:740] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:49.946703 17252 raft_consensus.cc:515] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.947172 17719 consensus_queue.cc:260] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:49.949930 17719 ts_tablet_manager.cc:1434] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:58:49.957653 17252 leader_election.cc:290] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:49.957455 16598 raft_consensus.cc:515] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:49.958635 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:49.964413 16531 raft_consensus.cc:3055] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:49.964651 16598 leader_election.cc:290] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:49.964775 16531 raft_consensus.cc:740] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:49.965638 16531 consensus_queue.cc:260] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.966840 16531 raft_consensus.cc:3060] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.968021 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2622edd6954367a260d3600443dd26" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:49.968546 16673 raft_consensus.cc:3060] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.972105 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2622edd6954367a260d3600443dd26" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:49.972622 16526 raft_consensus.cc:3055] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:49.972887 16526 raft_consensus.cc:740] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:49.973677 16531 raft_consensus.cc:2468] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:49.973531 16526 consensus_queue.cc:260] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:49.974546 16526 raft_consensus.cc:3060] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.974706 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-796b324679b4492db7f68598b0a2d4e2 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:49.974915 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801ee654117f4d37b4ad0c66b46fd4e4" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:49.975498 16603 raft_consensus.cc:3060] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:49.975603 17218 leader_election.cc:304] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 6e58e6edfb3b43b1b5378f9e9a26e842; no voters:
I20260204 08:58:49.976440 17713 raft_consensus.cc:2804] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:49.976886 17713 raft_consensus.cc:697] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:49.977687 17713 consensus_queue.cc:237] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:49.975131 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-796b324679b4492db7f68598b0a2d4e2 on tablet 796b324679b4492db7f68598b0a2d4e2 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:49.980540 17724 ts_tablet_manager.cc:933] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:49.981943 16603 raft_consensus.cc:2468] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:49.985013 16526 raft_consensus.cc:2468] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:49.987761 17719 ts_tablet_manager.cc:933] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:49.997118 17719 tablet_copy_client.cc:323] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:49.994724 16673 raft_consensus.cc:2468] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:49.999722 16572 leader_election.cc:304] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:50.001544 17706 raft_consensus.cc:2804] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:50.002118 17706 raft_consensus.cc:697] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:50.002887 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 4dc53e7c74664efe82fc5edb6dfca943 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:50.003525 17706 consensus_queue.cc:237] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:50.003440 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 4dc53e7c74664efe82fc5edb6dfca943 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-4dc53e7c74664efe82fc5edb6dfca943
I20260204 08:58:50.016052 16617 tablet_copy_source_session.cc:215] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:50.018368 16526 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:50.019415 17719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc53e7c74664efe82fc5edb6dfca943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:50.019747 17712 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:50.028923 16426 catalog_manager.cc:5654] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:50.038697 16427 catalog_manager.cc:5654] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:50.045776 17727 ts_tablet_manager.cc:933] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:50.046522 17724 tablet_copy_client.cc:323] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:50.046728 16673 raft_consensus.cc:1275] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:50.048674 17719 tablet_copy_client.cc:806] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:50.049238 17719 tablet_copy_client.cc:670] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:50.049875 17713 consensus_queue.cc:1048] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:50.053848 17727 tablet_copy_client.cc:323] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:50.054168 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 68912efba25745d9ba6be48c71f92a38 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:50.054719 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 68912efba25745d9ba6be48c71f92a38 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-68912efba25745d9ba6be48c71f92a38
I20260204 08:58:50.057422 16678 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:50.057577 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 3326e90f03344694ace417ed6615d3fa from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:50.058107 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 3326e90f03344694ace417ed6615d3fa from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-3326e90f03344694ace417ed6615d3fa
I20260204 08:58:50.059057 17712 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:50.070370 16617 tablet_copy_source_session.cc:215] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:50.072685 16691 tablet_copy_source_session.cc:215] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:50.076241 17719 tablet_copy_client.cc:538] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:50.076467 16531 raft_consensus.cc:1275] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:50.078114 17713 consensus_queue.cc:1048] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 08:58:50.083927 17727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3326e90f03344694ace417ed6615d3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:50.102392 17724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68912efba25745d9ba6be48c71f92a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:50.121479 17724 tablet_copy_client.cc:806] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:50.122109 17724 tablet_copy_client.cc:670] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:50.128290 17724 tablet_copy_client.cc:538] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:50.140434 17724 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:50.157207 16598 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:50.158689 17719 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:50.181977 17713 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 08:58:50.183739 17727 tablet_copy_client.cc:806] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:50.184540 17727 tablet_copy_client.cc:670] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:50.190287 16526 raft_consensus.cc:1275] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:50.192137 17715 consensus_queue.cc:1048] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 08:58:50.195626 17724 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:50.197772 17727 tablet_copy_client.cc:538] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:50.212318 17724 tablet_bootstrap.cc:492] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:50.213382 17727 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:50.215209 17724 ts_tablet_manager.cc:1403] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.075s user 0.024s sys 0.020s
I20260204 08:58:50.225723 17724 raft_consensus.cc:359] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:50.228084 17724 raft_consensus.cc:740] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:50.229193 17724 consensus_queue.cc:260] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:50.237802 17724 ts_tablet_manager.cc:1434] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.021s user 0.003s sys 0.002s
I20260204 08:58:50.239836 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-68912efba25745d9ba6be48c71f92a38 received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:50.240264 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-68912efba25745d9ba6be48c71f92a38 on tablet 68912efba25745d9ba6be48c71f92a38 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:50.249060 17727 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:50.250082 17727 tablet_bootstrap.cc:492] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:50.252883 17727 ts_tablet_manager.cc:1403] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.040s user 0.025s sys 0.005s
I20260204 08:58:50.256933 17727 raft_consensus.cc:359] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:50.257807 17727 raft_consensus.cc:740] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:50.258978 17719 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:50.258479 17727 consensus_queue.cc:260] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:50.264685 17251 raft_consensus.cc:1217] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:50.266623 17727 ts_tablet_manager.cc:1434] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.013s user 0.004s sys 0.001s
I20260204 08:58:50.276772 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-3326e90f03344694ace417ed6615d3fa received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:50.277216 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-3326e90f03344694ace417ed6615d3fa on tablet 3326e90f03344694ace417ed6615d3fa with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:50.264717 17719 tablet_bootstrap.cc:492] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:50.295182 17719 ts_tablet_manager.cc:1403] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.138s user 0.033s sys 0.009s
I20260204 08:58:50.299806 17719 raft_consensus.cc:359] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:50.302039 17719 raft_consensus.cc:740] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:50.302685 17719 consensus_queue.cc:260] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:50.306380 17719 ts_tablet_manager.cc:1434] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260204 08:58:50.307823 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-4dc53e7c74664efe82fc5edb6dfca943 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:50.308245 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-4dc53e7c74664efe82fc5edb6dfca943 on tablet 4dc53e7c74664efe82fc5edb6dfca943 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:50.364782 16680 raft_consensus.cc:1275] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:58:50.366216 17652 consensus_queue.cc:1048] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:50.369055 16598 raft_consensus.cc:1275] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:58:50.370342 17652 consensus_queue.cc:1048] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:50.417865 17251 raft_consensus.cc:1217] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:50.425513 16531 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:50.427227 17714 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 08:58:50.429556 16598 raft_consensus.cc:1275] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:50.432911 17714 consensus_queue.cc:1048] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:50.503572 17251 raft_consensus.cc:1217] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260204 08:58:50.512063 17251 raft_consensus.cc:1217] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:50.604566 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:50.604876 16531 raft_consensus.cc:1275] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:50.606669 17620 consensus_queue.cc:1048] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:50.622426 16680 raft_consensus.cc:1275] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:50.624207 17655 consensus_queue.cc:1048] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:50.661674 16680 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:50.662406 16680 raft_consensus.cc:606] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:50.666613 16674 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:50.667130 16674 raft_consensus.cc:606] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:50.671555 16600 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:50.672081 16600 raft_consensus.cc:606] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:50.673589 17620 raft_consensus.cc:993] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:50.673988 17620 raft_consensus.cc:1081] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:50.675459 17251 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41580
I20260204 08:58:50.675952 16680 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:50.675957 17251 raft_consensus.cc:493] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:50.676506 16680 raft_consensus.cc:606] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:50.676542 17251 raft_consensus.cc:3060] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.679098 16531 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e039f673c9814556a561795c68ee2950"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:50.679489 16531 raft_consensus.cc:606] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:50.683765 16680 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fc74f40262504431847cf4419a26b480"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:50.684244 16680 raft_consensus.cc:606] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:50.685333 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260204 08:58:50.684224 17251 raft_consensus.cc:515] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.688238 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:50.688910 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:50.689309 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:50.689920 16531 raft_consensus.cc:3060] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.690227 17251 leader_election.cc:290] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:50.690598 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aac4f009108d4057aee3fb4274b6d320" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:50.691116 16600 raft_consensus.cc:3055] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:50.691386 16600 raft_consensus.cc:740] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:50.692090 16600 consensus_queue.cc:260] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.693332 16600 raft_consensus.cc:3060] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.697113 16531 raft_consensus.cc:2468] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:50.698161 17218 leader_election.cc:304] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 6e58e6edfb3b43b1b5378f9e9a26e842; no voters:
I20260204 08:58:50.698854 17715 raft_consensus.cc:2804] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:50.699267 17715 raft_consensus.cc:697] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:50.700098 17715 consensus_queue.cc:237] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.700958 16600 raft_consensus.cc:2468] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:50.708097 16429 catalog_manager.cc:5654] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:50.796226 17722 raft_consensus.cc:993] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:50.796702 17687 raft_consensus.cc:1081] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:50.797957 16525 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55736
I20260204 08:58:50.798381 16525 raft_consensus.cc:493] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:50.798631 16525 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.803325 16525 raft_consensus.cc:515] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:50.804692 16525 leader_election.cc:290] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:50.805501 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:50.806089 16678 raft_consensus.cc:3055] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:50.806357 16678 raft_consensus.cc:740] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:50.806429 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:50.806977 16606 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.807000 16678 consensus_queue.cc:260] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:50.808274 16678 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.808386 17722 raft_consensus.cc:993] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:50.808897 17687 raft_consensus.cc:1081] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:50.810191 17251 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41592
I20260204 08:58:50.810693 17251 raft_consensus.cc:493] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:50.811081 17251 raft_consensus.cc:3060] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.818603 16678 raft_consensus.cc:2468] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:50.818900 16606 raft_consensus.cc:2468] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:50.819548 16497 leader_election.cc:304] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:50.820324 17711 raft_consensus.cc:2804] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:50.820732 17711 raft_consensus.cc:697] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:50.821426 17711 consensus_queue.cc:237] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:50.824267 17251 raft_consensus.cc:515] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.828933 17251 leader_election.cc:290] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:50.829519 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:50.830029 16606 raft_consensus.cc:3060] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.830750 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af129226cb2f41479ef5eb75771c860b" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:50.831430 16678 raft_consensus.cc:3055] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:50.831710 16678 raft_consensus.cc:740] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:50.832489 16678 consensus_queue.cc:260] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.833271 17654 raft_consensus.cc:993] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:50.833616 16678 raft_consensus.cc:3060] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.833685 17654 raft_consensus.cc:1081] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:50.835350 16531 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fc74f40262504431847cf4419a26b480"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55736
I20260204 08:58:50.835829 16531 raft_consensus.cc:493] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:50.836066 16606 raft_consensus.cc:2468] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:50.836177 16531 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.836999 17219 leader_election.cc:304] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:50.836666 16429 catalog_manager.cc:5654] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:50.837803 17715 raft_consensus.cc:2804] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:50.838291 17715 raft_consensus.cc:697] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:50.839979 17715 consensus_queue.cc:237] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.840847 16678 raft_consensus.cc:2468] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:50.842514 16531 raft_consensus.cc:515] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:50.844866 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc74f40262504431847cf4419a26b480" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:50.845376 16606 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.852694 16531 leader_election.cc:290] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:50.852873 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc74f40262504431847cf4419a26b480" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:50.853408 16680 raft_consensus.cc:3055] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:50.853678 16680 raft_consensus.cc:740] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:50.854336 16680 consensus_queue.cc:260] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:50.854832 16606 raft_consensus.cc:2468] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:50.855406 16680 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:50.855916 16498 leader_election.cc:304] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:50.856662 17671 raft_consensus.cc:2804] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:50.857086 17671 raft_consensus.cc:697] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:50.858379 17671 consensus_queue.cc:237] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:50.860298 16426 catalog_manager.cc:5654] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:50.863725 17620 raft_consensus.cc:1064] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:50.866664 17654 raft_consensus.cc:1064] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:50.866314 17620 consensus_queue.cc:237] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.868614 17654 consensus_queue.cc:237] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.877417 16680 raft_consensus.cc:2468] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:50.884066 17252 raft_consensus.cc:1275] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:50.889204 16674 raft_consensus.cc:1275] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:50.885646 16525 raft_consensus.cc:1275] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:50.891016 17252 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:50.891368 17760 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:50.892376 17706 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:50.893186 16525 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:50.895015 16606 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:50.882200 16426 catalog_manager.cc:5654] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:50.896255 17654 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260204 08:58:50.899905 17759 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:50.916627 17677 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:50.916419 17760 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:50.917522 17722 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:50.926640 17706 raft_consensus.cc:1064] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:50.929626 17252 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:50.933801 17706 consensus_queue.cc:237] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:50.940461 16429 catalog_manager.cc:5654] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:50.944947 16680 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:50.953078 17687 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:50.956131 16525 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:50.961628 17252 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:50.973421 16525 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:50.978921 16427 catalog_manager.cc:5654] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:51.002358 17759 raft_consensus.cc:1064] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:51.004998 17759 consensus_queue.cc:237] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:51.008001 16680 consensus_queue.cc:237] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:51.023059 17251 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:51.023754 16525 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:51.024896 17677 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:51.025503 17687 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:51.037140 16526 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:51.037140 16674 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:51.037976 17252 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:51.039723 17760 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:58:51.042263 17760 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:51.045255 17706 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:51.049985 17251 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.046757 17722 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.063060 17654 raft_consensus.cc:993] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:51.063469 17687 raft_consensus.cc:1081] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:51.061002 16525 raft_consensus.cc:2955] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.065315 16526 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55736
I20260204 08:58:51.065804 16526 raft_consensus.cc:493] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:51.066113 16526 raft_consensus.cc:3060] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.072736 16526 raft_consensus.cc:515] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.076213 16526 leader_election.cc:290] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:51.076854 16598 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:51.077481 16598 raft_consensus.cc:3060] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.078212 16680 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56a1c6e078b242738f19a73c490d3830" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:51.078706 16680 raft_consensus.cc:3055] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:51.078994 16680 raft_consensus.cc:740] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:51.079669 16680 consensus_queue.cc:260] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.080740 16680 raft_consensus.cc:3060] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.085347 16598 raft_consensus.cc:2468] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:51.087050 16680 raft_consensus.cc:2468] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:51.088172 16497 leader_election.cc:304] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:51.088917 17768 raft_consensus.cc:2804] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:51.089347 17768 raft_consensus.cc:697] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:51.090137 17768 consensus_queue.cc:237] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.103605 17706 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.106221 17671 raft_consensus.cc:993] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:51.106721 17671 raft_consensus.cc:1081] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:51.108062 16606 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e039f673c9814556a561795c68ee2950"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57790
I20260204 08:58:51.108549 16606 raft_consensus.cc:493] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:51.108857 16606 raft_consensus.cc:3060] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.109652 16598 consensus_queue.cc:237] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:51.115064 16606 raft_consensus.cc:515] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.117295 16606 leader_election.cc:290] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:51.113854 16674 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.124452 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:51.124956 16678 raft_consensus.cc:3060] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.125524 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e039f673c9814556a561795c68ee2950" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:51.126142 16531 raft_consensus.cc:3055] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:51.126410 16531 raft_consensus.cc:740] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:51.127118 16531 consensus_queue.cc:260] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.127123 16427 catalog_manager.cc:5654] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.128300 16531 raft_consensus.cc:3060] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.132637 16526 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.139689 16673 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:51.141453 16525 raft_consensus.cc:1275] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:51.141688 17253 raft_consensus.cc:1275] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:51.141878 16524 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:51.143229 17253 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:51.143740 17760 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:51.144317 16678 raft_consensus.cc:2468] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:51.145306 17620 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:51.146595 16572 leader_election.cc:304] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:51.146731 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 68912efba25745d9ba6be48c71f92a38 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:51.148029 17620 raft_consensus.cc:2804] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:51.148650 17620 raft_consensus.cc:697] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:51.149457 17620 consensus_queue.cc:237] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.143186 17655 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260204 08:58:51.153934 17655 consensus_queue.cc:1048] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:51.156056 16603 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:51.156170 17655 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:51.158600 17715 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:51.160924 17250 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.169615 17759 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.172406 17252 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.181210 17774 tablet_replica.cc:333] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:51.181934 16427 catalog_manager.cc:5654] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.189869 16525 raft_consensus.cc:2955] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.182374 17774 raft_consensus.cc:2243] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:51.200162 16429 catalog_manager.cc:5654] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:51.202215 16524 raft_consensus.cc:1275] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:51.203590 17715 consensus_queue.cc:1048] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:51.206108 17774 pending_rounds.cc:70] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: Trying to abort 1 pending ops.
I20260204 08:58:51.207593 17774 pending_rounds.cc:77] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7250720894433411072 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "68912efba25745d9ba6be48c71f92a38" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } } }
I20260204 08:58:51.209594 17774 raft_consensus.cc:2917] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260204 08:58:51.211396 17774 raft_consensus.cc:2889] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260204 08:58:51.211824 17774 raft_consensus.cc:2272] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:51.215874 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 796b324679b4492db7f68598b0a2d4e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:51.217267 17774 ts_tablet_manager.cc:1916] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:51.224690 17655 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.235743 17774 ts_tablet_manager.cc:1929] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:51.236316 17774 log.cc:1199] T 68912efba25745d9ba6be48c71f92a38 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/68912efba25745d9ba6be48c71f92a38
I20260204 08:58:51.238229 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 68912efba25745d9ba6be48c71f92a38 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:51.240906 16678 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.242719 16531 raft_consensus.cc:2468] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
W20260204 08:58:51.244350 17776 log.cc:927] Time spent T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260204 08:58:51.244462 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 68912efba25745d9ba6be48c71f92a38 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:51.246243 17251 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.253609 16429 catalog_manager.cc:5654] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:51.260377 16429 catalog_manager.cc:5654] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:51.238993 16426 catalog_manager.cc:5654] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:51.272470 16526 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.278863 16603 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:51.280686 17715 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:51.288453 16600 raft_consensus.cc:1275] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:51.289647 17768 consensus_queue.cc:1048] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:51.341404 16678 raft_consensus.cc:1275] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:51.350677 17715 consensus_queue.cc:1048] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:51.394038 16600 consensus_queue.cc:237] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:51.400586 16678 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:51.403311 17655 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:51.404269 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 796b324679b4492db7f68598b0a2d4e2 with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:51.425307 17655 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.426422 16678 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
W20260204 08:58:51.440279 17218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 82703.1us
I20260204 08:58:51.469687 17251 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:51.474128 16603 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:51.477855 16598 consensus_queue.cc:237] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:51.479358 17788 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:58:51.479888 17760 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260204 08:58:51.488188 16673 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:51.489446 17706 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:51.492591 16427 catalog_manager.cc:5654] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 4 to 5, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.494192 17252 raft_consensus.cc:2955] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.495831 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3326e90f03344694ace417ed6615d3fa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:51.500245 16673 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.504360 17252 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:51.509174 17793 tablet_replica.cc:333] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:51.510313 17793 raft_consensus.cc:2243] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:51.510991 17793 raft_consensus.cc:2272] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:51.511998 17760 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:51.498221 17655 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.521545 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4dc53e7c74664efe82fc5edb6dfca943 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:51.523968 16675 raft_consensus.cc:1275] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:51.531558 16674 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:51.533660 17252 raft_consensus.cc:2955] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.537366 17793 ts_tablet_manager.cc:1916] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:51.561180 16429 catalog_manager.cc:5654] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:51.567113 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 3326e90f03344694ace417ed6615d3fa with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:51.581478 16673 raft_consensus.cc:1275] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:51.582747 17655 consensus_queue.cc:1048] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:51.587508 17711 consensus_queue.cc:1048] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:51.598796 16517 tablet_service.cc:1552] Processing DeleteTablet for tablet 4dc53e7c74664efe82fc5edb6dfca943 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:51.613329 17788 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:51.618093 16678 raft_consensus.cc:1275] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:51.633225 17798 consensus_queue.cc:1048] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260204 08:58:51.636406 17799 tablet_replica.cc:333] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:51.644829 16598 raft_consensus.cc:1275] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:51.655203 16524 raft_consensus.cc:1275] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:51.657826 17786 consensus_queue.cc:1048] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260204 08:58:51.658530 17620 consensus_queue.cc:1048] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:51.682709 17799 raft_consensus.cc:2243] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:51.683627 17799 raft_consensus.cc:2272] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:51.705981 17799 ts_tablet_manager.cc:1916] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:51.708143 17793 ts_tablet_manager.cc:1929] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:51.708882 17793 log.cc:1199] T 796b324679b4492db7f68598b0a2d4e2 P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/796b324679b4492db7f68598b0a2d4e2
I20260204 08:58:51.710573 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 796b324679b4492db7f68598b0a2d4e2 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:51.736002 17799 ts_tablet_manager.cc:1929] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260204 08:58:51.737370 17799 log.cc:1199] T 3326e90f03344694ace417ed6615d3fa P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/3326e90f03344694ace417ed6615d3fa
I20260204 08:58:51.738996 17799 tablet_replica.cc:333] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:51.738936 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 3326e90f03344694ace417ed6615d3fa (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:51.739953 17799 raft_consensus.cc:2243] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:51.741056 17799 raft_consensus.cc:2272] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:51.744133 17799 ts_tablet_manager.cc:1916] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:51.749848 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:51.757743 17799 ts_tablet_manager.cc:1929] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:51.758209 17799 log.cc:1199] T 4dc53e7c74664efe82fc5edb6dfca943 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/4dc53e7c74664efe82fc5edb6dfca943
I20260204 08:58:51.760528 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 4dc53e7c74664efe82fc5edb6dfca943 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:51.788940 16524 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:51.789378 16524 raft_consensus.cc:606] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:51.791211 16524 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "063bb12920e44068a818b00a8573328e"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:51.791568 16524 raft_consensus.cc:606] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:51.793478 16674 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:51.793948 16674 raft_consensus.cc:606] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:51.796398 16600 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "232077fdd4b44876ba13c53b7f42f888"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:51.796934 16600 raft_consensus.cc:606] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:51.798970 16674 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:51.799364 16674 raft_consensus.cc:606] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:51.801878 16531 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:51.802346 16531 raft_consensus.cc:606] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:51.803320 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260204 08:58:51.804373 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:51.804874 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:51.833324 17786 raft_consensus.cc:993] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:51.833833 17786 raft_consensus.cc:1081] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:51.835112 16600 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57790
I20260204 08:58:51.835597 16600 raft_consensus.cc:493] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:51.835947 16600 raft_consensus.cc:3060] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.842120 16600 raft_consensus.cc:515] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.843775 16600 leader_election.cc:290] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:51.844624 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:51.844532 16524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0081bf9327d5467897615fd29a2a5ad6" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:51.845183 16674 raft_consensus.cc:3060] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.845304 16524 raft_consensus.cc:3055] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:51.845671 16524 raft_consensus.cc:740] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:51.846375 16524 consensus_queue.cc:260] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.847510 16524 raft_consensus.cc:3060] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:51.851069 16674 raft_consensus.cc:2468] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:51.852059 16572 leader_election.cc:304] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:51.852726 17759 raft_consensus.cc:2804] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:51.853096 17759 raft_consensus.cc:697] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:51.853273 16524 raft_consensus.cc:2468] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:51.853838 17759 consensus_queue.cc:237] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:51.863366 16429 catalog_manager.cc:5654] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:51.999595 17654 raft_consensus.cc:993] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:52.000059 17654 raft_consensus.cc:1081] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:52.002136 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41592
I20260204 08:58:52.002720 17252 raft_consensus.cc:493] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:52.003435 17252 raft_consensus.cc:3060] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.004458 17655 raft_consensus.cc:993] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:52.004855 17655 raft_consensus.cc:1081] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:52.006630 16524 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "232077fdd4b44876ba13c53b7f42f888"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55724
I20260204 08:58:52.007189 16524 raft_consensus.cc:493] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:52.007550 16524 raft_consensus.cc:3060] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.012192 17252 raft_consensus.cc:515] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.013301 16524 raft_consensus.cc:515] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:52.014714 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:52.015267 16531 raft_consensus.cc:3060] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.015853 17252 leader_election.cc:290] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:52.016192 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "232077fdd4b44876ba13c53b7f42f888" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:52.015195 16676 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68912efba25745d9ba6be48c71f92a38" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:52.016741 16600 raft_consensus.cc:3055] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:52.016834 16676 raft_consensus.cc:3055] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:52.016290 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "232077fdd4b44876ba13c53b7f42f888" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:52.017133 16600 raft_consensus.cc:740] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:52.017335 16676 raft_consensus.cc:740] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:52.017472 16674 raft_consensus.cc:3060] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.017917 16600 consensus_queue.cc:260] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:52.018105 16676 consensus_queue.cc:260] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.018942 16600 raft_consensus.cc:3060] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.019330 16676 raft_consensus.cc:3060] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.021507 16531 raft_consensus.cc:2468] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:52.015280 16524 leader_election.cc:290] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:52.022536 17218 leader_election.cc:304] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 6e58e6edfb3b43b1b5378f9e9a26e842; no voters:
I20260204 08:58:52.023351 17791 raft_consensus.cc:2804] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:52.023488 16674 raft_consensus.cc:2468] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:52.023947 17791 raft_consensus.cc:697] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:52.024291 16600 raft_consensus.cc:2468] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:52.024709 16497 leader_election.cc:304] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:52.025358 17791 consensus_queue.cc:237] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.026117 17786 raft_consensus.cc:2804] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:52.026588 17786 raft_consensus.cc:697] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:52.027371 17786 consensus_queue.cc:237] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:52.029150 16676 raft_consensus.cc:2468] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:52.035401 16429 catalog_manager.cc:5654] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:52.047924 16429 catalog_manager.cc:5654] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 1 to 2, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:52.146430 17798 raft_consensus.cc:993] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:52.146870 17786 raft_consensus.cc:1081] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:52.148397 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "063bb12920e44068a818b00a8573328e"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41584
I20260204 08:58:52.148895 17252 raft_consensus.cc:493] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:52.149185 17252 raft_consensus.cc:3060] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.153138 17252 raft_consensus.cc:515] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.154688 17252 leader_election.cc:290] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:52.155242 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:52.155810 16531 raft_consensus.cc:3055] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:52.156122 16531 raft_consensus.cc:740] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:52.156333 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "063bb12920e44068a818b00a8573328e" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:52.156858 16674 raft_consensus.cc:3060] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.156754 16531 consensus_queue.cc:260] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.158078 16531 raft_consensus.cc:3060] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.164186 16531 raft_consensus.cc:2468] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:52.164472 16674 raft_consensus.cc:2468] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:52.165172 17218 leader_election.cc:304] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 6e58e6edfb3b43b1b5378f9e9a26e842; no voters:
I20260204 08:58:52.165904 17713 raft_consensus.cc:2804] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:52.166347 17713 raft_consensus.cc:697] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:52.167111 17713 consensus_queue.cc:237] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.174907 16429 catalog_manager.cc:5654] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:52.241787 16531 raft_consensus.cc:1275] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:52.242827 17760 consensus_queue.cc:1048] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:52.251400 16674 raft_consensus.cc:1275] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:52.253273 17760 consensus_queue.cc:1048] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:52.281105 17654 raft_consensus.cc:993] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:52.281489 17722 raft_consensus.cc:1081] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:52.283356 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41592
I20260204 08:58:52.283857 17252 raft_consensus.cc:493] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:52.284211 17252 raft_consensus.cc:3060] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.289655 17252 raft_consensus.cc:515] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.290937 17252 leader_election.cc:290] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:52.291769 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:52.292032 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20fa246d3c414fa0b616da38a625bdfe" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:52.292358 16674 raft_consensus.cc:3055] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:52.292654 16674 raft_consensus.cc:740] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:52.293401 16674 consensus_queue.cc:260] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.294411 16674 raft_consensus.cc:3060] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.298470 16674 raft_consensus.cc:2468] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:52.299188 17218 leader_election.cc:304] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters: f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:52.299731 17713 raft_consensus.cc:2804] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:52.300113 17713 raft_consensus.cc:697] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:52.300773 17713 consensus_queue.cc:237] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:52.307147 16427 catalog_manager.cc:5654] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:52.376417 17798 raft_consensus.cc:993] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:52.376880 17786 raft_consensus.cc:1081] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:52.378165 16599 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57790
I20260204 08:58:52.378546 16599 raft_consensus.cc:493] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:52.378845 16599 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:52.383301 16599 raft_consensus.cc:515] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:52.384617 16599 leader_election.cc:290] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 3 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:52.385326 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:52.385427 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2c39bf3d0c849a1aa4ef353e0e67991" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:52.385917 16531 raft_consensus.cc:3055] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:52.385974 16674 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:52.386169 16531 raft_consensus.cc:740] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:52.386747 16531 consensus_queue.cc:260] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:52.387562 16531 raft_consensus.cc:3060] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:52.390861 16674 raft_consensus.cc:2468] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 3.
I20260204 08:58:52.391749 16572 leader_election.cc:304] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:52.392433 17706 raft_consensus.cc:2804] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:52.393190 17706 raft_consensus.cc:697] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 3 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:52.392589 16531 raft_consensus.cc:2468] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 3.
I20260204 08:58:52.394076 17706 consensus_queue.cc:237] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:52.401494 16427 catalog_manager.cc:5654] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 2 to 3, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 3 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:52.467244 16599 raft_consensus.cc:1275] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:52.468231 17798 consensus_queue.cc:1048] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:52.477468 16674 raft_consensus.cc:1275] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:52.479507 17817 consensus_queue.cc:1048] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260204 08:58:52.486673 16674 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:52.488149 17713 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:52.506929 16531 raft_consensus.cc:1275] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:52.511231 17713 consensus_queue.cc:1048] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:52.570848 16531 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:52.571909 17791 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:52.581103 16676 raft_consensus.cc:1275] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:52.583001 17821 consensus_queue.cc:1048] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:52.597728 16674 consensus_queue.cc:237] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
W20260204 08:58:52.608219 16647 consensus_peers.cc:597] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4773c29a00ab47f9b55fd479ace200e7. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:52.609243 16531 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:52.610495 17654 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:52.613358 16600 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:52.614486 17654 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:52.621656 17722 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.623358 16600 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.623540 16531 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.639357 16427 catalog_manager.cc:5654] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.644253 16531 consensus_queue.cc:237] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:52.752847 16600 raft_consensus.cc:3060] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:52.764431 16600 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:52.766745 17821 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:52.789597 16603 raft_consensus.cc:1275] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:52.792959 17786 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:58:52.842453 16498 consensus_peers.cc:597] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 326778f65c8845f5bc8e4a236d093bfe. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:52.847361 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:52.858649 16674 raft_consensus.cc:1275] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:52.877722 16678 raft_consensus.cc:1275] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:52.886005 17788 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:52.886544 17821 consensus_queue.cc:1048] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:52.913712 17830 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.914422 16674 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.922878 16606 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.948915 16526 consensus_queue.cc:237] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:52.950569 16429 catalog_manager.cc:5654] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.962991 16676 raft_consensus.cc:1275] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:52.964252 16498 consensus_peers.cc:597] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35fde83161df49e09eb28ee05a4ad35f. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:52.963014 16606 raft_consensus.cc:1275] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:52.968775 16676 raft_consensus.cc:1275] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:52.968950 17817 consensus_queue.cc:1048] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:52.970705 17817 consensus_queue.cc:1048] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:52.971312 17829 consensus_queue.cc:1048] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:52.974548 16606 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:52.975052 16606 raft_consensus.cc:606] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Received request to transfer leadership to TS 86e16045049f4f87a94336b5d2262328
I20260204 08:58:52.980191 17830 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.985642 16673 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:52.987752 16676 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:52.989917 16676 raft_consensus.cc:606] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:52.989185 16526 raft_consensus.cc:1275] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:52.992599 17829 consensus_queue.cc:1048] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:52.994122 16526 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:52.994802 16526 raft_consensus.cc:606] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:52.996232 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260204 08:58:52.997742 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:52.999348 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:53.003026 16676 consensus_queue.cc:237] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.018930 16427 catalog_manager.cc:5654] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:53.033952 16606 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:53.036033 16526 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:53.040676 16647 consensus_peers.cc:597] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12675d44700947d9871774efc58a8b70. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:53.042452 17654 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:53.049225 16599 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:53.056944 17687 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:53.065897 17817 raft_consensus.cc:993] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:53.066368 17817 raft_consensus.cc:1081] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:53.077400 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41584
I20260204 08:58:53.077979 17252 raft_consensus.cc:493] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:53.078336 17252 raft_consensus.cc:3060] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.092939 17835 raft_consensus.cc:993] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:53.093472 17654 raft_consensus.cc:1081] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:53.095309 16524 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55736
I20260204 08:58:53.095834 16524 raft_consensus.cc:493] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:53.096186 16524 raft_consensus.cc:3060] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.101577 17835 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:53.103889 16606 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:53.117676 16524 raft_consensus.cc:515] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.124984 16524 leader_election.cc:290] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:53.129037 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:53.129598 16600 raft_consensus.cc:3060] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.134964 17252 raft_consensus.cc:515] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:53.165613 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4773c29a00ab47f9b55fd479ace200e7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:53.197009 16673 raft_consensus.cc:3055] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:53.197374 16673 raft_consensus.cc:740] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:53.198108 16673 consensus_queue.cc:260] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.199347 16673 raft_consensus.cc:3060] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.200811 16600 raft_consensus.cc:2468] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:53.201504 16598 raft_consensus.cc:1240] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Rejecting Update request from peer 86e16045049f4f87a94336b5d2262328 for earlier term 1. Current term is 2. Ops: []
I20260204 08:58:53.205994 16524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:53.206882 17252 leader_election.cc:290] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:53.208242 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61ec06ad82864d3a91228c325fd1af2d" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:53.211027 16600 raft_consensus.cc:3060] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.213832 16498 leader_election.cc:304] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:53.218843 17798 raft_consensus.cc:2804] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:53.224954 17798 raft_consensus.cc:697] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:53.222136 16526 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:53.225899 17798 consensus_queue.cc:237] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.221060 16600 raft_consensus.cc:2468] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:53.228783 17219 leader_election.cc:304] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:53.217912 16673 raft_consensus.cc:2468] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:53.218086 16524 raft_consensus.cc:3055] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:53.232232 16427 catalog_manager.cc:5654] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:53.233327 17713 raft_consensus.cc:2804] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:53.233850 17713 raft_consensus.cc:697] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:53.234611 17713 consensus_queue.cc:237] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:53.237021 16524 raft_consensus.cc:740] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:53.237792 16524 consensus_queue.cc:260] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:53.242107 16524 raft_consensus.cc:3060] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.251999 16430 catalog_manager.cc:5654] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:53.254436 16426 catalog_manager.cc:5654] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:53.258234 16524 raft_consensus.cc:2468] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:53.348577 17846 ts_tablet_manager.cc:933] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:53.350726 17846 tablet_copy_client.cc:323] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:53.352417 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 326778f65c8845f5bc8e4a236d093bfe from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:53.352952 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 326778f65c8845f5bc8e4a236d093bfe from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-326778f65c8845f5bc8e4a236d093bfe
I20260204 08:58:53.359512 16541 tablet_copy_source_session.cc:215] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:53.362071 17846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326778f65c8845f5bc8e4a236d093bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:53.375670 17846 tablet_copy_client.cc:806] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:53.376194 17846 tablet_copy_client.cc:670] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:53.379058 17846 tablet_copy_client.cc:538] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:53.385486 17846 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:53.405238 17846 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:53.406100 17846 tablet_bootstrap.cc:492] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:53.406608 17846 ts_tablet_manager.cc:1403] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.004s
I20260204 08:58:53.409243 17846 raft_consensus.cc:359] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.410035 17846 raft_consensus.cc:740] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:53.410537 17846 consensus_queue.cc:260] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.412806 17846 ts_tablet_manager.cc:1434] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260204 08:58:53.417325 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-326778f65c8845f5bc8e4a236d093bfe received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:53.417744 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-326778f65c8845f5bc8e4a236d093bfe on tablet 326778f65c8845f5bc8e4a236d093bfe with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:53.449873 17706 raft_consensus.cc:993] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:53.450343 17706 raft_consensus.cc:1081] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Signalling peer 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:53.451910 16673 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:40262
I20260204 08:58:53.453670 16673 raft_consensus.cc:493] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:53.454077 16673 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.460376 16673 raft_consensus.cc:515] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:53.463469 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:53.464006 16600 raft_consensus.cc:3055] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:53.464272 16600 raft_consensus.cc:740] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:53.464804 16600 consensus_queue.cc:260] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:53.465459 16600 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.466500 16673 leader_election.cc:290] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:53.466487 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:53.467175 16526 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:53.473034 16600 raft_consensus.cc:2468] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:53.473026 16526 raft_consensus.cc:2468] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:53.475231 16647 leader_election.cc:304] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:53.475979 17687 raft_consensus.cc:2804] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:53.476365 17687 raft_consensus.cc:697] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:53.476962 17687 consensus_queue.cc:237] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:53.487836 16426 catalog_manager.cc:5654] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 1 to 2, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:53.494724 17846 ts_tablet_manager.cc:933] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:53.496366 17846 tablet_copy_client.cc:323] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:53.497527 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 35fde83161df49e09eb28ee05a4ad35f from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:53.498024 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 35fde83161df49e09eb28ee05a4ad35f from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-35fde83161df49e09eb28ee05a4ad35f
I20260204 08:58:53.506033 16541 tablet_copy_source_session.cc:215] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:53.508821 17846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fde83161df49e09eb28ee05a4ad35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:53.518496 17851 ts_tablet_manager.cc:933] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:53.520263 17851 tablet_copy_client.cc:323] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:53.521862 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 12675d44700947d9871774efc58a8b70 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:53.522342 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 12675d44700947d9871774efc58a8b70 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-12675d44700947d9871774efc58a8b70
I20260204 08:58:53.527297 16691 tablet_copy_source_session.cc:215] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:53.530068 17851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12675d44700947d9871774efc58a8b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:53.532125 17846 tablet_copy_client.cc:806] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:53.533859 17846 tablet_copy_client.cc:670] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:53.536928 17846 tablet_copy_client.cc:538] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:53.544546 17851 tablet_copy_client.cc:806] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:53.545131 17851 tablet_copy_client.cc:670] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:53.546502 17846 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:53.548731 17851 tablet_copy_client.cc:538] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:53.557125 17851 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:53.565644 17846 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:53.566608 17846 tablet_bootstrap.cc:492] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:53.567341 17846 ts_tablet_manager.cc:1403] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.005s
I20260204 08:58:53.570130 17846 raft_consensus.cc:359] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.571007 17846 raft_consensus.cc:740] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:53.571702 17846 consensus_queue.cc:260] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.574146 17846 ts_tablet_manager.cc:1434] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:58:53.575591 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-35fde83161df49e09eb28ee05a4ad35f received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:53.576017 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-35fde83161df49e09eb28ee05a4ad35f on tablet 35fde83161df49e09eb28ee05a4ad35f with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:53.584781 17851 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:53.585688 17851 tablet_bootstrap.cc:492] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:53.586366 17851 ts_tablet_manager.cc:1403] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.006s
I20260204 08:58:53.602186 17851 raft_consensus.cc:359] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.602784 17851 raft_consensus.cc:740] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:53.603518 17851 consensus_queue.cc:260] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:53.605746 17851 ts_tablet_manager.cc:1434] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.019s user 0.004s sys 0.000s
I20260204 08:58:53.607519 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-12675d44700947d9871774efc58a8b70 received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:53.607964 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-12675d44700947d9871774efc58a8b70 on tablet 12675d44700947d9871774efc58a8b70 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:53.642021 16600 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260204 08:58:53.643009 17830 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:53.653829 16674 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260204 08:58:53.654857 17798 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260204 08:58:53.655885 16498 consensus_peers.cc:597] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4773c29a00ab47f9b55fd479ace200e7. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:53.656239 16606 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:53.658320 17821 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:53.684718 16524 raft_consensus.cc:1275] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:53.685830 17791 consensus_queue.cc:1048] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:53.876299 16606 raft_consensus.cc:1275] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:53.877290 17843 consensus_queue.cc:1048] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:53.897464 16526 raft_consensus.cc:1275] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:53.898653 17843 consensus_queue.cc:1048] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:53.917105 17252 raft_consensus.cc:1217] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:53.963688 17252 raft_consensus.cc:1217] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:53.975482 17252 raft_consensus.cc:1217] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:54.223402 17868 ts_tablet_manager.cc:933] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:54.224880 17868 tablet_copy_client.cc:323] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:54.225999 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 4773c29a00ab47f9b55fd479ace200e7 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:54.226397 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 4773c29a00ab47f9b55fd479ace200e7 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-4773c29a00ab47f9b55fd479ace200e7
I20260204 08:58:54.232122 16541 tablet_copy_source_session.cc:215] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:54.234354 17868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4773c29a00ab47f9b55fd479ace200e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:54.248431 17868 tablet_copy_client.cc:806] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:54.249006 17868 tablet_copy_client.cc:670] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:54.252215 17868 tablet_copy_client.cc:538] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:54.259891 17868 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:54.263145 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:54.289830 17868 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:54.290807 17868 tablet_bootstrap.cc:492] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:54.291486 17868 ts_tablet_manager.cc:1403] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.032s user 0.022s sys 0.008s
I20260204 08:58:54.308549 17868 raft_consensus.cc:359] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:54.309407 17868 raft_consensus.cc:740] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:54.310073 17868 consensus_queue.cc:260] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:54.312530 17868 ts_tablet_manager.cc:1434] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260204 08:58:54.315496 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-4773c29a00ab47f9b55fd479ace200e7 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:54.315864 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-4773c29a00ab47f9b55fd479ace200e7 on tablet 4773c29a00ab47f9b55fd479ace200e7 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:54.337170 16606 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:54.337715 16606 raft_consensus.cc:606] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Received request to transfer leadership to TS 86e16045049f4f87a94336b5d2262328
I20260204 08:58:54.340153 16673 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:54.340654 16673 raft_consensus.cc:606] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:54.342926 16524 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fc74f40262504431847cf4419a26b480"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:54.343441 16524 raft_consensus.cc:606] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:54.346694 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260204 08:58:54.347899 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:54.348546 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:54.350271 17798 raft_consensus.cc:1064] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:54.352906 17798 consensus_queue.cc:237] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.362844 17830 raft_consensus.cc:1064] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:54.365123 17830 consensus_queue.cc:237] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.376856 17251 raft_consensus.cc:1275] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.380007 16673 raft_consensus.cc:1275] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.380299 16674 raft_consensus.cc:1275] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.381469 16600 raft_consensus.cc:1275] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.382251 17867 consensus_queue.cc:1048] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.383684 17251 raft_consensus.cc:1275] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.384007 17867 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.386260 16606 raft_consensus.cc:1275] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.395999 17798 consensus_queue.cc:1048] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.397782 17798 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.399524 17867 consensus_queue.cc:1048] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.401700 17857 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.427573 17867 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.428567 17250 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.431587 17865 raft_consensus.cc:993] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:54.432062 17865 raft_consensus.cc:1081] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:54.433475 16524 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55736
I20260204 08:58:54.433959 16524 raft_consensus.cc:493] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:54.434286 16524 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:54.435866 17857 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.448611 16674 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.448963 16430 catalog_manager.cc:5654] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.450006 16678 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.459942 16524 raft_consensus.cc:515] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:54.472709 16524 leader_election.cc:290] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:54.474916 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:54.475569 16678 raft_consensus.cc:3055] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:54.475930 16678 raft_consensus.cc:740] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:54.477423 16600 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.478063 17250 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.482503 16599 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:54.483038 16599 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:54.476662 16678 consensus_queue.cc:260] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:54.489017 16603 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.497225 16599 raft_consensus.cc:2468] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:54.501124 16498 leader_election.cc:304] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:54.502506 17867 raft_consensus.cc:2804] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:54.502966 17867 raft_consensus.cc:697] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:54.503811 17867 consensus_queue.cc:237] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:54.529232 17875 raft_consensus.cc:993] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:54.529853 17875 raft_consensus.cc:1081] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:54.531606 16600 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fc74f40262504431847cf4419a26b480"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57790
I20260204 08:58:54.532155 16600 raft_consensus.cc:493] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:54.532507 16600 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:54.488075 16678 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:54.536662 17887 raft_consensus.cc:993] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:54.537719 17887 raft_consensus.cc:1081] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Signalling peer 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:54.544206 16674 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:40262
I20260204 08:58:54.544765 16674 raft_consensus.cc:493] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:54.545223 16674 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:54.547310 16600 raft_consensus.cc:515] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:54.551499 16525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc74f40262504431847cf4419a26b480" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:54.551865 16600 leader_election.cc:290] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 3 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:54.547631 16678 raft_consensus.cc:2468] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:54.552109 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc74f40262504431847cf4419a26b480" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:54.552273 16525 raft_consensus.cc:3055] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:54.553143 16525 raft_consensus.cc:740] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:54.552852 16673 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:54.553798 16525 consensus_queue.cc:260] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:54.554888 16525 raft_consensus.cc:3060] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:54.556780 16427 catalog_manager.cc:5654] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.559478 16673 raft_consensus.cc:2468] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 3.
I20260204 08:58:54.560329 16674 raft_consensus.cc:515] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.560726 16572 leader_election.cc:304] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:54.561973 16674 leader_election.cc:290] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 3 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:58:54.568508 17706 raft_consensus.cc:2804] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:54.568878 17706 raft_consensus.cc:697] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 3 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:54.569607 17706 consensus_queue.cc:237] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:54.586170 16525 raft_consensus.cc:2468] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 3.
W20260204 08:58:54.586411 16647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:42667, user_credentials={real_user=slave}} blocked reactor thread for 79359.4us
I20260204 08:58:54.588793 16524 consensus_queue.cc:237] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.596891 17252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:58:54.597482 17252 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:54.598193 17865 raft_consensus.cc:1064] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:54.600441 17865 consensus_queue.cc:237] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.602723 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3326e90f03344694ace417ed6615d3fa" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:54.603262 16606 raft_consensus.cc:3055] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:54.602308 17250 raft_consensus.cc:1275] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:54.603543 16606 raft_consensus.cc:740] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:54.604285 16606 consensus_queue.cc:260] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.605384 16606 raft_consensus.cc:3060] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:54.603516 17252 raft_consensus.cc:2468] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 3.
I20260204 08:58:54.607733 17857 consensus_queue.cc:1048] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:54.611212 16606 raft_consensus.cc:2468] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 3.
I20260204 08:58:54.611477 16647 leader_election.cc:304] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:54.612542 17843 raft_consensus.cc:2804] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:54.613030 17843 raft_consensus.cc:697] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 3 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:54.608772 16428 catalog_manager.cc:5654] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 2 to 3, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 3 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:54.613837 17843 consensus_queue.cc:237] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.616101 17798 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.620142 17251 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.624027 16524 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.625958 17883 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.626679 16599 raft_consensus.cc:1275] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:54.628376 16427 catalog_manager.cc:5654] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:54.639755 17857 consensus_queue.cc:1048] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:54.642014 16427 catalog_manager.cc:5654] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.644763 16531 consensus_queue.cc:237] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.647022 17252 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.649055 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 35fde83161df49e09eb28ee05a4ad35f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:54.652820 16599 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:54.655782 16599 raft_consensus.cc:1275] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:54.655827 17251 raft_consensus.cc:1275] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:54.658346 17843 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.659953 17687 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:54.661890 16606 raft_consensus.cc:2955] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.666523 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 35fde83161df49e09eb28ee05a4ad35f with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:54.674608 17867 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:54.677549 17867 consensus_queue.cc:1048] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:54.711546 17884 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.713292 16606 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.721915 17250 raft_consensus.cc:1217] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260204 08:58:54.717528 17251 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.738978 17892 tablet_replica.cc:333] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:54.739989 17892 raft_consensus.cc:2243] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:54.740592 17892 raft_consensus.cc:2272] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:54.740478 16524 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.716995 16430 catalog_manager.cc:5654] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 2 to 3, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:54.748116 16606 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.746716 17857 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.748564 16427 catalog_manager.cc:5654] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.753198 17250 raft_consensus.cc:2955] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.767557 17892 ts_tablet_manager.cc:1916] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:54.768190 16674 consensus_queue.cc:237] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:54.776683 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 326778f65c8845f5bc8e4a236d093bfe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:54.782071 16599 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:54.782882 17250 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:54.783337 17884 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:58:54.784710 17843 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:54.795347 16427 catalog_manager.cc:5654] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.797984 17843 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.806820 17250 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.810460 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 12675d44700947d9871774efc58a8b70 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:54.816732 16606 raft_consensus.cc:2955] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:54.820271 17892 ts_tablet_manager.cc:1929] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:54.819872 16429 catalog_manager.cc:5654] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:54.823707 17892 log.cc:1199] T 35fde83161df49e09eb28ee05a4ad35f P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/35fde83161df49e09eb28ee05a4ad35f
I20260204 08:58:54.824570 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 326778f65c8845f5bc8e4a236d093bfe with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:54.827713 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 35fde83161df49e09eb28ee05a4ad35f (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:54.830446 17892 tablet_replica.cc:333] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:54.838982 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 12675d44700947d9871774efc58a8b70 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:54.846170 17895 tablet_replica.cc:333] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:54.849416 17895 raft_consensus.cc:2243] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:54.850163 17895 raft_consensus.cc:2272] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:54.854719 17892 raft_consensus.cc:2243] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:54.855489 17892 raft_consensus.cc:2272] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:54.856665 17895 ts_tablet_manager.cc:1916] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:54.858786 17892 ts_tablet_manager.cc:1916] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:54.872061 17895 ts_tablet_manager.cc:1929] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:54.872438 17895 log.cc:1199] T 12675d44700947d9871774efc58a8b70 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/12675d44700947d9871774efc58a8b70
I20260204 08:58:54.873795 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 12675d44700947d9871774efc58a8b70 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:54.877938 17892 ts_tablet_manager.cc:1929] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:54.878307 17892 log.cc:1199] T 326778f65c8845f5bc8e4a236d093bfe P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/326778f65c8845f5bc8e4a236d093bfe
I20260204 08:58:54.879921 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 326778f65c8845f5bc8e4a236d093bfe (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:54.905658 16673 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:54.906853 17875 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:54.925369 16606 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:54.930076 17857 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:54.985754 16673 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:54.987071 17706 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:55.001339 16531 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:55.004627 17760 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:55.157011 17250 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260204 08:58:55.158461 17903 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260204 08:58:55.170954 16599 raft_consensus.cc:1275] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260204 08:58:55.172677 17843 consensus_queue.cc:1048] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260204 08:58:55.195938 17867 raft_consensus.cc:1064] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:55.198376 17867 consensus_queue.cc:237] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.212253 16673 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:55.213138 17251 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:55.214370 16599 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:55.215560 17867 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:55.216336 17830 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:55.216995 17875 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:55.236548 17875 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:55.240800 17250 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:55.243803 16600 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:55.248009 16673 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:55.254778 16429 catalog_manager.cc:5654] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 2 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:55.271492 16531 consensus_queue.cc:237] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.279837 17250 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:55.280619 16673 raft_consensus.cc:1275] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:55.282123 17830 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:55.282902 17857 consensus_queue.cc:1048] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:55.288456 17857 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:55.290024 16674 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:55.294232 17250 raft_consensus.cc:2955] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:55.298555 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4773c29a00ab47f9b55fd479ace200e7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:55.306208 16427 catalog_manager.cc:5654] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 4 to 5, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:55.315446 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 4773c29a00ab47f9b55fd479ace200e7 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:55.317514 17911 tablet_replica.cc:333] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:55.318353 17911 raft_consensus.cc:2243] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:55.319016 17911 raft_consensus.cc:2272] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:55.322094 17911 ts_tablet_manager.cc:1916] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:55.335460 17911 ts_tablet_manager.cc:1929] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260204 08:58:55.335777 17911 log.cc:1199] T 4773c29a00ab47f9b55fd479ace200e7 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/4773c29a00ab47f9b55fd479ace200e7
I20260204 08:58:55.337049 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 4773c29a00ab47f9b55fd479ace200e7 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:55.411829 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:55.445590 16674 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "12675d44700947d9871774efc58a8b70"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:55.446061 16674 raft_consensus.cc:606] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:55.448380 16600 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:55.448884 16600 raft_consensus.cc:606] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Received request to transfer leadership to TS 86e16045049f4f87a94336b5d2262328
I20260204 08:58:55.451017 16674 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:55.451484 16674 raft_consensus.cc:606] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:55.454109 16525 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:55.454558 16525 raft_consensus.cc:606] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:55.455669 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260204 08:58:55.456753 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:55.457280 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:55.779691 17886 raft_consensus.cc:993] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:55.780143 17886 raft_consensus.cc:1081] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Signalling peer 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:55.781371 16674 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:40262
I20260204 08:58:55.781854 16674 raft_consensus.cc:493] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:55.782124 16674 raft_consensus.cc:3060] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.786728 16674 raft_consensus.cc:515] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.788050 16674 leader_election.cc:290] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:58:55.788556 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:55.788838 17251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3018fb4c08d3462f90e72e4df6d716c8" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:58:55.789094 16600 raft_consensus.cc:3055] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:55.789389 17251 raft_consensus.cc:3060] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.789402 16600 raft_consensus.cc:740] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:55.790254 16600 consensus_queue.cc:260] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.791726 16600 raft_consensus.cc:3060] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.794855 17251 raft_consensus.cc:2468] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:55.795748 16647 leader_election.cc:304] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:55.796319 17843 raft_consensus.cc:2804] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:55.796777 17843 raft_consensus.cc:697] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:55.797698 16600 raft_consensus.cc:2468] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:55.797580 17843 consensus_queue.cc:237] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.799795 17884 raft_consensus.cc:993] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:55.800181 17883 raft_consensus.cc:1081] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:55.801643 16600 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "12675d44700947d9871774efc58a8b70"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57796
I20260204 08:58:55.802155 16600 raft_consensus.cc:493] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:55.802471 16600 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.806519 16600 raft_consensus.cc:515] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.806557 16430 catalog_manager.cc:5654] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 1 to 2, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:55.807847 16600 leader_election.cc:290] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:58:55.808429 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:55.808954 16674 raft_consensus.cc:3055] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:55.809079 17251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:58:55.809288 16674 raft_consensus.cc:740] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:55.809621 17251 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.809967 16674 consensus_queue.cc:260] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.811076 16674 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.815459 17251 raft_consensus.cc:2468] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:55.817306 16573 leader_election.cc:304] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:55.818667 17760 raft_consensus.cc:2804] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:55.819084 17760 raft_consensus.cc:697] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:55.819720 17760 consensus_queue.cc:237] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.820936 16674 raft_consensus.cc:2468] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:55.827589 17867 raft_consensus.cc:993] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:55.828048 17867 raft_consensus.cc:1081] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:55.827682 16430 catalog_manager.cc:5654] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:55.829193 17251 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41584
I20260204 08:58:55.829635 17251 raft_consensus.cc:493] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:55.830103 17251 raft_consensus.cc:3060] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.835691 17251 raft_consensus.cc:515] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.837210 17251 leader_election.cc:290] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:55.837878 16531 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:55.838248 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f0ef5121b748d18bbd7783a318fbc7" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:55.838419 16531 raft_consensus.cc:3055] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:55.838729 16531 raft_consensus.cc:740] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:55.838738 16674 raft_consensus.cc:3060] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.839390 16531 consensus_queue.cc:260] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.841351 17884 raft_consensus.cc:993] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:55.841815 17843 raft_consensus.cc:1081] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:55.841904 16531 raft_consensus.cc:3060] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:55.843169 16525 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55736
I20260204 08:58:55.843633 16525 raft_consensus.cc:493] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:55.843957 16525 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:55.846783 16674 raft_consensus.cc:2468] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:55.847858 17218 leader_election.cc:304] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:55.848538 17713 raft_consensus.cc:2804] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:55.849001 17713 raft_consensus.cc:697] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:55.849870 17713 consensus_queue.cc:237] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:55.850608 16531 raft_consensus.cc:2468] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:55.855036 16525 raft_consensus.cc:515] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:55.857781 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:55.858335 16673 raft_consensus.cc:3055] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:55.858608 16673 raft_consensus.cc:740] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:55.859261 16673 consensus_queue.cc:260] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:55.860272 16673 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:55.860976 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c7e1fed9cf44fa0b10d749e42e6d702" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:55.861377 16600 raft_consensus.cc:3060] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:55.865542 16600 raft_consensus.cc:2468] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 3.
I20260204 08:58:55.865646 16673 raft_consensus.cc:2468] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 3.
I20260204 08:58:55.866153 16525 leader_election.cc:290] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 3 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:55.866505 16498 leader_election.cc:304] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:55.867810 17867 raft_consensus.cc:2804] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:55.866109 16430 catalog_manager.cc:5654] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:55.868265 17867 raft_consensus.cc:697] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:55.869124 17867 consensus_queue.cc:237] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:55.880455 16430 catalog_manager.cc:5654] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 2 to 3, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 3 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:56.224184 16674 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:56.225345 17886 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:56.233755 17251 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:56.235858 17760 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:56.247128 16600 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:56.249851 17843 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:56.250391 16678 raft_consensus.cc:1275] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:56.253746 17857 consensus_queue.cc:1048] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260204 08:58:56.261236 16606 raft_consensus.cc:1275] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:58:56.263116 17867 consensus_queue.cc:1048] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:56.289774 17251 raft_consensus.cc:1275] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:56.290827 17912 consensus_queue.cc:1048] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:56.383538 16525 consensus_queue.cc:237] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:56.389557 16674 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260204 08:58:56.390233 16498 consensus_peers.cc:597] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fd60f400d0147959fa060cf8359ae32. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:56.390290 16600 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260204 08:58:56.390779 17857 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:56.391620 17830 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:56.398599 17857 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.400135 16674 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.404172 16673 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:56.405620 17821 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:56.400836 16600 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.424918 16606 consensus_queue.cc:237] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:56.425827 16525 raft_consensus.cc:1275] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:56.427163 17713 consensus_queue.cc:1048] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:56.426554 16430 catalog_manager.cc:5654] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 3, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260204 08:58:56.459360 16573 consensus_peers.cc:597] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8689b3435b4f43a1b5a8c5af26f23c2c. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:56.462654 16673 raft_consensus.cc:1275] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:56.463292 16525 raft_consensus.cc:1275] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:56.464223 17886 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:56.465085 17760 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:56.489457 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:56.490226 17760 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.493733 16673 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.505173 16674 consensus_queue.cc:237] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:56.506053 16430 catalog_manager.cc:5654] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:56.533558 16600 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:56.534024 16531 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:56.534209 16647 consensus_peers.cc:597] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 92baf1e833884e0b9132f786b6d9791f. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:56.535490 17883 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:56.537168 17843 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:56.493647 16525 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.544305 17883 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.553799 16674 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0f175f5811e74a91b26e6ac39bc9d0b7"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:56.554385 16674 raft_consensus.cc:606] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:56.555506 16600 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.557319 16606 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:56.557881 16606 raft_consensus.cc:606] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Received request to transfer leadership to TS 86e16045049f4f87a94336b5d2262328
I20260204 08:58:56.561219 16531 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:56.561713 16531 raft_consensus.cc:606] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:56.563529 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260204 08:58:56.563942 16524 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.574678 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:56.574918 16531 consensus_queue.cc:237] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:56.575875 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:56.578696 16430 catalog_manager.cc:5654] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260204 08:58:56.588814 16498 consensus_peers.cc:597] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2e4ca7bedb84f7ba570333f98fb5de5. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:56.590554 16600 raft_consensus.cc:1275] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:56.590622 16674 raft_consensus.cc:1275] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:56.596339 17857 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:56.598971 17857 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:56.609974 17875 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.669529 16600 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.684267 16430 catalog_manager.cc:5654] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260204 08:58:56.705858 16646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:39621, user_credentials={real_user=slave}} blocked reactor thread for 48922.1us
I20260204 08:58:56.720294 16678 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:56.747815 17706 raft_consensus.cc:993] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:56.748262 17706 raft_consensus.cc:1081] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Signalling peer 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:56.751569 16678 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:40262
I20260204 08:58:56.752091 16678 raft_consensus.cc:493] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:56.752432 16678 raft_consensus.cc:3060] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:56.759060 16678 raft_consensus.cc:515] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:56.760752 16678 leader_election.cc:290] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:56.761390 16524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:56.761907 16524 raft_consensus.cc:3060] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:56.762619 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "376fb0bb77c04a0d9daf4939af20207f" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:56.763142 16600 raft_consensus.cc:3055] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:56.763401 16600 raft_consensus.cc:740] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:56.764303 16600 consensus_queue.cc:260] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:56.765380 16600 raft_consensus.cc:3060] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:56.768249 16524 raft_consensus.cc:2468] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:56.769084 16646 leader_election.cc:304] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:56.769627 17912 raft_consensus.cc:2804] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:56.769989 17912 raft_consensus.cc:697] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:56.770705 17912 consensus_queue.cc:237] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:56.770877 16600 raft_consensus.cc:2468] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:56.783291 16429 catalog_manager.cc:5654] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 1 to 2, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } }
I20260204 08:58:56.892244 17946 ts_tablet_manager.cc:933] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:56.893996 17946 tablet_copy_client.cc:323] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:56.895403 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet 3fd60f400d0147959fa060cf8359ae32 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:56.895890 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet 3fd60f400d0147959fa060cf8359ae32 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-3fd60f400d0147959fa060cf8359ae32
I20260204 08:58:56.901535 16541 tablet_copy_source_session.cc:215] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:56.904553 17946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd60f400d0147959fa060cf8359ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:56.912789 17948 ts_tablet_manager.cc:933] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:58:56.919046 17946 tablet_copy_client.cc:806] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:56.919593 17946 tablet_copy_client.cc:670] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:56.921707 17948 tablet_copy_client.cc:323] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:58:56.922868 17946 tablet_copy_client.cc:538] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:56.923049 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 8689b3435b4f43a1b5a8c5af26f23c2c from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:58:56.923590 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 8689b3435b4f43a1b5a8c5af26f23c2c from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-8689b3435b4f43a1b5a8c5af26f23c2c
I20260204 08:58:56.930581 17946 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:56.931794 16617 tablet_copy_source_session.cc:215] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:56.942838 17948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8689b3435b4f43a1b5a8c5af26f23c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:56.972188 17843 raft_consensus.cc:993] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:56.972716 17883 raft_consensus.cc:1081] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:56.975608 16525 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0f175f5811e74a91b26e6ac39bc9d0b7"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55736
I20260204 08:58:56.976227 16525 raft_consensus.cc:493] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:56.976547 16525 raft_consensus.cc:3060] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:56.985738 17948 tablet_copy_client.cc:806] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:56.986274 17948 tablet_copy_client.cc:670] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:56.985390 16525 raft_consensus.cc:515] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:56.988713 16525 leader_election.cc:290] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:56.989380 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f175f5811e74a91b26e6ac39bc9d0b7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:56.989944 16606 raft_consensus.cc:3060] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:56.990325 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f175f5811e74a91b26e6ac39bc9d0b7" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:56.990825 16678 raft_consensus.cc:3055] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:56.991075 16678 raft_consensus.cc:740] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:56.991583 17946 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:56.991714 16678 consensus_queue.cc:260] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:56.992933 17946 tablet_bootstrap.cc:492] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:56.993597 17946 ts_tablet_manager.cc:1403] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.063s user 0.027s sys 0.000s
I20260204 08:58:56.992796 16678 raft_consensus.cc:3060] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:56.997814 17948 tablet_copy_client.cc:538] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:56.998302 17946 raft_consensus.cc:359] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:56.998330 16606 raft_consensus.cc:2468] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:57.001904 16498 leader_election.cc:304] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:56.999109 17946 raft_consensus.cc:740] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:57.003417 17857 raft_consensus.cc:2804] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:57.003895 17857 raft_consensus.cc:697] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:57.002684 17946 consensus_queue.cc:260] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:57.005343 17946 ts_tablet_manager.cc:1434] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260204 08:58:57.004575 17857 consensus_queue.cc:237] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:57.009256 17948 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:57.009779 16678 raft_consensus.cc:2468] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:57.016743 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-3fd60f400d0147959fa060cf8359ae32 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:57.017198 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-3fd60f400d0147959fa060cf8359ae32 on tablet 3fd60f400d0147959fa060cf8359ae32 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:57.027295 16430 catalog_manager.cc:5654] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:57.038348 17946 ts_tablet_manager.cc:933] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:57.040992 17948 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:57.043057 17948 tablet_bootstrap.cc:492] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:57.045670 17948 ts_tablet_manager.cc:1403] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.037s user 0.020s sys 0.010s
I20260204 08:58:57.047997 17953 ts_tablet_manager.cc:933] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:57.048210 17946 tablet_copy_client.cc:323] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:58:57.049726 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 92baf1e833884e0b9132f786b6d9791f from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:58:57.049635 17948 raft_consensus.cc:359] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:57.050315 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 92baf1e833884e0b9132f786b6d9791f from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-92baf1e833884e0b9132f786b6d9791f
I20260204 08:58:57.050494 17948 raft_consensus.cc:740] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:57.051146 17948 consensus_queue.cc:260] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:57.053793 17948 ts_tablet_manager.cc:1434] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260204 08:58:57.055840 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-8689b3435b4f43a1b5a8c5af26f23c2c received from {username='slave'} at 127.0.0.1:38144
I20260204 08:58:57.056241 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-8689b3435b4f43a1b5a8c5af26f23c2c on tablet 8689b3435b4f43a1b5a8c5af26f23c2c with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:57.059077 16691 tablet_copy_source_session.cc:215] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:57.062080 17946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92baf1e833884e0b9132f786b6d9791f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:57.064013 17953 tablet_copy_client.cc:323] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:57.065440 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet a2e4ca7bedb84f7ba570333f98fb5de5 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:57.065932 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet a2e4ca7bedb84f7ba570333f98fb5de5 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-a2e4ca7bedb84f7ba570333f98fb5de5
I20260204 08:58:57.073663 16541 tablet_copy_source_session.cc:215] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:57.077033 17946 tablet_copy_client.cc:806] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:57.078506 17946 tablet_copy_client.cc:670] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:57.080786 17953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e4ca7bedb84f7ba570333f98fb5de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:58:57.082422 17946 tablet_copy_client.cc:538] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:57.089473 17946 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:57.095242 17953 tablet_copy_client.cc:806] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:58:57.095813 17953 tablet_copy_client.cc:670] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:58:57.100241 17953 tablet_copy_client.cc:538] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:58:57.108201 17953 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:58:57.115356 17946 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:57.116339 17946 tablet_bootstrap.cc:492] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:57.117030 17946 ts_tablet_manager.cc:1403] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.028s user 0.017s sys 0.004s
I20260204 08:58:57.120327 17946 raft_consensus.cc:359] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:57.121202 17946 raft_consensus.cc:740] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:57.121853 17946 consensus_queue.cc:260] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:57.124485 17946 ts_tablet_manager.cc:1434] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260204 08:58:57.126758 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-92baf1e833884e0b9132f786b6d9791f received from {username='slave'} at 127.0.0.1:36626
I20260204 08:58:57.127162 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-92baf1e833884e0b9132f786b6d9791f on tablet 92baf1e833884e0b9132f786b6d9791f with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:57.132651 17953 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:58:57.134306 17953 tablet_bootstrap.cc:492] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:58:57.134923 17953 ts_tablet_manager.cc:1403] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.027s user 0.017s sys 0.004s
I20260204 08:58:57.137524 17953 raft_consensus.cc:359] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:57.138181 17953 raft_consensus.cc:740] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:58:57.138763 17953 consensus_queue.cc:260] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:57.142280 17953 ts_tablet_manager.cc:1434] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260204 08:58:57.147171 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-a2e4ca7bedb84f7ba570333f98fb5de5 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:58:57.147563 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-a2e4ca7bedb84f7ba570333f98fb5de5 on tablet a2e4ca7bedb84f7ba570333f98fb5de5 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:57.162318 17857 raft_consensus.cc:993] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:57.162721 17875 raft_consensus.cc:1081] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:57.164587 16600 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57790
I20260204 08:58:57.165084 16600 raft_consensus.cc:493] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:57.165341 16600 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:57.170871 16600 raft_consensus.cc:515] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:57.172497 16600 leader_election.cc:290] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 4 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:57.174091 16678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:57.174654 16678 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:57.180644 16525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91a7c7c248c04840817bf3090ca01597" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:57.180761 16678 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 4.
I20260204 08:58:57.181187 16525 raft_consensus.cc:3055] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:58:57.181495 16525 raft_consensus.cc:740] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:57.181747 16572 leader_election.cc:304] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:57.182108 16525 consensus_queue.cc:260] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:57.182403 17886 raft_consensus.cc:2804] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:58:57.182890 17886 raft_consensus.cc:697] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 4 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:57.183614 17886 consensus_queue.cc:237] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:58:57.184718 16525 raft_consensus.cc:3060] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:58:57.190955 16525 raft_consensus.cc:2468] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 4.
I20260204 08:58:57.200031 16429 catalog_manager.cc:5654] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 3 to 4, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:57.281126 16599 raft_consensus.cc:1275] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:57.283330 17843 consensus_queue.cc:1048] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:57.302317 16524 raft_consensus.cc:1275] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:57.304466 17843 consensus_queue.cc:1048] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:57.348578 17251 raft_consensus.cc:1217] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260204 08:58:57.405992 17251 raft_consensus.cc:1217] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:57.480943 16600 raft_consensus.cc:1275] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:57.483811 17875 consensus_queue.cc:1048] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:57.493741 16673 raft_consensus.cc:1275] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:58:57.495052 17875 consensus_queue.cc:1048] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:57.505048 17251 raft_consensus.cc:1217] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:57.605378 16525 raft_consensus.cc:1275] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 4 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:58:57.606612 17959 consensus_queue.cc:1048] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:57.618237 16673 raft_consensus.cc:1275] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 4 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:58:57.620496 17886 consensus_queue.cc:1048] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:57.642268 17251 raft_consensus.cc:1217] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:58:57.731734 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:57.769304 17867 raft_consensus.cc:1064] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:57.770916 17867 consensus_queue.cc:237] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:57.779666 17251 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:57.780269 16678 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:57.780464 16599 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260204 08:58:57.781629 17857 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:57.783188 17857 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:57.786875 17857 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:57.784116 16525 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:57.851656 17875 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.852133 16600 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.854012 16525 raft_consensus.cc:606] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:58:57.860188 16606 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:57.860705 16606 raft_consensus.cc:606] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Received request to transfer leadership to TS 86e16045049f4f87a94336b5d2262328
I20260204 08:58:57.861397 17251 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.868145 16673 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:57.869318 16673 raft_consensus.cc:606] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 35380a227e2c4fa4a063d4fd67c30b53
I20260204 08:58:57.870442 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260204 08:58:57.868935 16427 catalog_manager.cc:5654] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.872005 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:57.872713 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:57.874373 16673 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.914361 16525 consensus_queue.cc:237] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:57.918006 17706 raft_consensus.cc:1064] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:57.920274 17706 consensus_queue.cc:237] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:57.930567 16678 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:57.930886 17251 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:57.931233 17250 raft_consensus.cc:1275] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:57.932046 17857 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:57.933229 17886 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:57.933794 17857 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:57.933190 16678 raft_consensus.cc:1275] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:57.939819 17886 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:57.942574 17857 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.944155 17250 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.952311 17867 raft_consensus.cc:993] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:57.952677 17867 raft_consensus.cc:1081] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:58:57.954037 16600 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57790
I20260204 08:58:57.954602 16600 raft_consensus.cc:493] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:57.954929 16600 raft_consensus.cc:3060] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:57.962091 16525 raft_consensus.cc:1275] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:57.963570 17706 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:57.955265 16674 raft_consensus.cc:2955] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.971251 16428 catalog_manager.cc:5654] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 4 to 5, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:57.972437 16600 raft_consensus.cc:515] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:57.978046 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3fd60f400d0147959fa060cf8359ae32 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:57.979140 16526 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:57.979736 16526 raft_consensus.cc:3055] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:57.980016 16526 raft_consensus.cc:740] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:57.980643 16526 consensus_queue.cc:260] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:57.981642 16526 raft_consensus.cc:3060] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:57.985132 17884 raft_consensus.cc:1064] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:57.986107 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet 3fd60f400d0147959fa060cf8359ae32 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:57.987603 17884 consensus_queue.cc:237] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.001021 17886 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.007984 16674 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.028352 17250 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.035619 16427 catalog_manager.cc:5654] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:58.040872 16526 raft_consensus.cc:2468] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:58.042215 16600 leader_election.cc:290] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:58:58.047573 17251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bff71b9804b47cc915e34b23012509e" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:58:58.048120 17251 raft_consensus.cc:3060] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:58.050495 16572 leader_election.cc:304] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:58.051353 17886 raft_consensus.cc:2804] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:58.053197 17886 raft_consensus.cc:697] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:58.054199 17886 consensus_queue.cc:237] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.060724 17251 raft_consensus.cc:2468] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:58:58.063414 16525 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.075120 17883 raft_consensus.cc:993] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: : Instructing follower 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:58.075572 17843 raft_consensus.cc:1081] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 35380a227e2c4fa4a063d4fd67c30b53 to start an election
I20260204 08:58:58.076963 16526 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
from {username='slave'} at 127.0.0.1:55736
I20260204 08:58:58.077463 16526 raft_consensus.cc:493] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:58.078075 16526 raft_consensus.cc:3060] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:58.083595 17980 tablet_replica.cc:333] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:58.083407 16427 catalog_manager.cc:5654] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 1 to 2, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:58.084753 17980 raft_consensus.cc:2243] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:58.085731 17980 raft_consensus.cc:2272] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:58.090445 16526 raft_consensus.cc:515] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.093758 17980 ts_tablet_manager.cc:1916] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:58.103529 17251 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:58.105170 17843 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:58.106428 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:58.106957 16673 raft_consensus.cc:3055] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:58.107213 16673 raft_consensus.cc:740] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:58.107868 16673 consensus_queue.cc:260] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.108860 16673 raft_consensus.cc:3060] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:58.108948 16526 leader_election.cc:290] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Requested vote from peers 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:58:58.098562 16600 consensus_queue.cc:237] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.117262 17251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "795715e8aaa1450e811ecebf022fd69b" candidate_uuid: "35380a227e2c4fa4a063d4fd67c30b53" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:58:58.117835 17251 raft_consensus.cc:3060] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:58.120179 17252 raft_consensus.cc:1275] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:58.121865 17959 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:58.125367 17251 raft_consensus.cc:2468] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:58.127429 17980 ts_tablet_manager.cc:1929] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260204 08:58:58.127936 17980 log.cc:1199] T 3fd60f400d0147959fa060cf8359ae32 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/3fd60f400d0147959fa060cf8359ae32
I20260204 08:58:58.128799 17706 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.130609 17252 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.138891 16606 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:58.141073 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 8689b3435b4f43a1b5a8c5af26f23c2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:58.141711 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet 3fd60f400d0147959fa060cf8359ae32 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:58.147533 16526 raft_consensus.cc:1275] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:58.149804 16498 leader_election.cc:304] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, 6e58e6edfb3b43b1b5378f9e9a26e842; no voters:
I20260204 08:58:58.150437 17857 raft_consensus.cc:2804] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:58.150882 17857 raft_consensus.cc:697] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Leader. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:58.150285 16427 catalog_manager.cc:5654] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:58.151640 17857 consensus_queue.cc:237] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.142468 17883 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260204 08:58:58.159060 16525 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:58.161254 17843 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:58:58.165412 16673 raft_consensus.cc:2468] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35380a227e2c4fa4a063d4fd67c30b53 in term 2.
I20260204 08:58:58.169951 17706 consensus_queue.cc:1048] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:58.175987 17883 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.176903 16526 raft_consensus.cc:2955] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.180814 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 8689b3435b4f43a1b5a8c5af26f23c2c with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:58:58.183045 17988 tablet_replica.cc:333] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:58:58.183997 17988 raft_consensus.cc:2243] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:58.184640 17988 raft_consensus.cc:2272] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:58.184770 16525 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.193393 16606 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.198130 17988 ts_tablet_manager.cc:1916] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:58.203063 17250 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.207931 17857 raft_consensus.cc:1064] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:58:58.210048 17857 consensus_queue.cc:237] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.217649 16428 catalog_manager.cc:5654] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:58.227442 16674 raft_consensus.cc:1275] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:58.228125 16606 raft_consensus.cc:1275] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:58.229416 17250 raft_consensus.cc:1275] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:58:58.212944 16427 catalog_manager.cc:5654] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193). New cstate: current_term: 2 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:58.233448 17988 ts_tablet_manager.cc:1929] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:58.233843 17988 log.cc:1199] T 8689b3435b4f43a1b5a8c5af26f23c2c P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/8689b3435b4f43a1b5a8c5af26f23c2c
I20260204 08:58:58.235978 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 8689b3435b4f43a1b5a8c5af26f23c2c (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:58.237048 17857 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:58.239442 17867 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:58.240962 17867 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:58:58.242153 16674 consensus_queue.cc:237] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.258361 17250 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:58.259865 16600 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:58.259095 17867 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.259943 17883 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:58.262384 17883 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:58.268587 17884 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.271314 17252 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.276588 16676 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.276923 16600 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.286494 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 92baf1e833884e0b9132f786b6d9791f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:58.292570 16599 raft_consensus.cc:2955] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.293357 17251 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.306191 16427 catalog_manager.cc:5654] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.308398 16429 catalog_manager.cc:5654] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.336786 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 92baf1e833884e0b9132f786b6d9791f with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:58:58.343191 16526 consensus_queue.cc:237] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.349427 17250 raft_consensus.cc:1275] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:58.350533 17857 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:58.356830 17984 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.366119 17250 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.368459 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet a2e4ca7bedb84f7ba570333f98fb5de5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:58:58.372107 16673 raft_consensus.cc:1275] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:58:58.379868 17886 raft_consensus.cc:993] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:58.379987 17875 consensus_queue.cc:1048] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:58.380468 17760 raft_consensus.cc:1081] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Signalling peer 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:58.382246 16676 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:40262
I20260204 08:58:58.382696 16676 raft_consensus.cc:493] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:58.383020 16676 raft_consensus.cc:3060] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:58.383380 17993 tablet_replica.cc:333] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:58:58.383913 16673 raft_consensus.cc:2955] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:58:58.389096 16676 raft_consensus.cc:515] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.392769 17993 raft_consensus.cc:2243] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:58.393421 17993 raft_consensus.cc:2272] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:58.393568 16676 leader_election.cc:290] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:58:58.394279 16428 catalog_manager.cc:5654] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:58.394750 17250 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:58:58.395527 17250 raft_consensus.cc:3060] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:58.395946 16599 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dc53e7c74664efe82fc5edb6dfca943" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:58.396466 16599 raft_consensus.cc:3055] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:58.396746 16599 raft_consensus.cc:740] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:58.397393 16599 consensus_queue.cc:260] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.398507 16599 raft_consensus.cc:3060] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:58.411402 17250 raft_consensus.cc:2468] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:58.412168 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet a2e4ca7bedb84f7ba570333f98fb5de5 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:58:58.412386 17993 ts_tablet_manager.cc:1916] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:58.413180 16647 leader_election.cc:304] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:58.414702 17883 raft_consensus.cc:2804] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:58.415138 17883 raft_consensus.cc:697] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:58.416420 17883 consensus_queue.cc:237] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:58.417794 16599 raft_consensus.cc:2468] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:58.423214 17980 tablet_replica.cc:333] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:58:58.424074 17980 raft_consensus.cc:2243] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:58:58.424731 17980 raft_consensus.cc:2272] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:58:58.427942 17980 ts_tablet_manager.cc:1916] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:58:58.433200 17993 ts_tablet_manager.cc:1929] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:58.433619 17993 log.cc:1199] T 92baf1e833884e0b9132f786b6d9791f P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/92baf1e833884e0b9132f786b6d9791f
I20260204 08:58:58.436318 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 92baf1e833884e0b9132f786b6d9791f (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:58.441069 16429 catalog_manager.cc:5654] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 1 to 2, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:58.448839 17980 ts_tablet_manager.cc:1929] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:58:58.449220 17980 log.cc:1199] T a2e4ca7bedb84f7ba570333f98fb5de5 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/a2e4ca7bedb84f7ba570333f98fb5de5
I20260204 08:58:58.450475 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet a2e4ca7bedb84f7ba570333f98fb5de5 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:58:58.457741 17250 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:58.458985 17886 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:58.466849 16526 raft_consensus.cc:1275] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:58.468004 17886 consensus_queue.cc:1048] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:58.647992 17250 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:58.649245 17857 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:58.657521 16676 raft_consensus.cc:1275] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:58.659260 17984 consensus_queue.cc:1048] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:58.918977 17252 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:58.920318 17884 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:58.920610 16606 raft_consensus.cc:1275] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:58.927156 17884 consensus_queue.cc:1048] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:58.981473 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:59.088950 16526 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32"
dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41102
I20260204 08:58:59.089592 16526 raft_consensus.cc:606] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:59.092025 16676 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:58:59.092427 16676 raft_consensus.cc:606] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:58:59.094844 16606 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:58:59.095312 16606 raft_consensus.cc:606] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Received request to transfer leadership to TS 86e16045049f4f87a94336b5d2262328
I20260204 08:58:59.096590 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260204 08:58:59.097702 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:58:59.098816 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:58:59.181792 17959 raft_consensus.cc:993] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:59.182269 17706 raft_consensus.cc:1081] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Signalling peer 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:58:59.183422 16676 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:40262
I20260204 08:58:59.183903 16676 raft_consensus.cc:493] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:59.184183 16676 raft_consensus.cc:3060] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:59.189311 16676 raft_consensus.cc:515] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.191507 16676 leader_election.cc:290] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:58:59.192355 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:59.193003 16606 raft_consensus.cc:3055] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:59.193095 17252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c2c27e6ec9949a0ae96e967adf3ffd9" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:58:59.193364 16606 raft_consensus.cc:740] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:58:59.193709 17252 raft_consensus.cc:3060] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:59.194331 16606 consensus_queue.cc:260] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.195731 16606 raft_consensus.cc:3060] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:59.199975 17252 raft_consensus.cc:2468] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:59.201319 16647 leader_election.cc:304] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:59.202461 17884 raft_consensus.cc:2804] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:59.203869 17884 raft_consensus.cc:697] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:59.202490 16606 raft_consensus.cc:2468] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:58:59.204849 17884 consensus_queue.cc:237] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.213393 16429 catalog_manager.cc:5654] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 1 to 2, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:59.261091 17884 raft_consensus.cc:993] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:59.261627 17912 raft_consensus.cc:1081] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:59.262845 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41592
I20260204 08:58:59.263219 17252 raft_consensus.cc:493] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:59.263429 17252 raft_consensus.cc:3060] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:59.267931 17252 raft_consensus.cc:515] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.269183 17252 leader_election.cc:290] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:59.269891 16606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:58:59.270077 16676 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92baf1e833884e0b9132f786b6d9791f" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:59.270545 16676 raft_consensus.cc:3055] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:58:59.270553 16606 raft_consensus.cc:3060] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:59.270918 16676 raft_consensus.cc:740] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:58:59.271741 16676 consensus_queue.cc:260] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.273226 16676 raft_consensus.cc:3060] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:58:59.281536 16606 raft_consensus.cc:2468] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:59.283332 17219 leader_election.cc:304] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:58:59.283571 16676 raft_consensus.cc:2468] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 2.
I20260204 08:58:59.284313 17713 raft_consensus.cc:2804] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:58:59.284727 17713 raft_consensus.cc:697] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:59.285565 17713 consensus_queue.cc:237] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.294170 16429 catalog_manager.cc:5654] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:58:59.446022 16526 consensus_queue.cc:237] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:59.451218 16674 raft_consensus.cc:1275] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:59.451771 16498 consensus_peers.cc:597] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d51b94b814b049a19e2c94de66731467. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:59.451912 16606 raft_consensus.cc:1275] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:59.452505 17867 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:59.453277 17857 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:59.461086 17984 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.462235 16606 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.462437 16674 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.479465 16606 consensus_queue.cc:237] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:59.477720 16429 catalog_manager.cc:5654] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.487972 16674 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260204 08:58:59.488552 16573 consensus_peers.cc:597] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc74f40262504431847cf4419a26b480. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:59.491528 16526 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260204 08:58:59.491560 17706 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:59.494314 17706 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:58:59.501329 17706 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.504575 16524 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.524166 16674 consensus_queue.cc:237] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:59.529661 16676 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.530725 16428 catalog_manager.cc:5654] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 4, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 3 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:59.589356 16524 raft_consensus.cc:1275] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:59.589740 16606 raft_consensus.cc:1275] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:58:59.590229 16647 consensus_peers.cc:597] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4fba286cf394487ab1cf2b45d55835b. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:59.590816 17912 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:59.591835 17883 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:59.601500 17884 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.616211 17252 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:59.614934 16606 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.621508 17912 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:59.622942 17857 raft_consensus.cc:993] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:59.623526 18006 raft_consensus.cc:1081] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:58:59.624887 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41584
I20260204 08:58:59.625428 17252 raft_consensus.cc:493] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:58:59.625797 17252 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:59.634344 17252 raft_consensus.cc:515] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.636842 17252 leader_election.cc:290] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 3 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:58:59.638325 16674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:58:59.638855 16674 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:59.641281 16676 consensus_queue.cc:237] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:58:59.643301 16525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3fd60f400d0147959fa060cf8359ae32" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:58:59.643847 16525 raft_consensus.cc:3055] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:58:59.644105 16525 raft_consensus.cc:740] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35380a227e2c4fa4a063d4fd67c30b53, State: Running, Role: LEADER
I20260204 08:58:59.646484 16674 raft_consensus.cc:2468] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 3.
I20260204 08:58:59.647624 17218 leader_election.cc:304] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:58:59.650813 17821 raft_consensus.cc:2804] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:58:59.644742 16525 consensus_queue.cc:260] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.653441 16525 raft_consensus.cc:3060] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:58:59.653208 16427 catalog_manager.cc:5654] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260204 08:58:59.665189 16524 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.667078 16606 raft_consensus.cc:1275] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:59.670585 17912 consensus_queue.cc:1048] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:59.677922 17821 raft_consensus.cc:697] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:58:59.678961 17821 consensus_queue.cc:237] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:58:59.661893 16525 raft_consensus.cc:2468] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 3.
I20260204 08:58:59.685935 16599 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:59.687844 18027 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:58:59.716475 16427 catalog_manager.cc:5654] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 2 to 3, leader changed from 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 3 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260204 08:58:59.771922 16647 consensus_peers.cc:597] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82c2a342cc8c4de99746b3951b711b0c. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:58:59.774798 16524 raft_consensus.cc:1275] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:59.782264 17884 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:59.784819 16600 raft_consensus.cc:1275] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:58:59.786649 16674 raft_consensus.cc:1275] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:58:59.789772 17912 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:58:59.800379 18037 consensus_queue.cc:1048] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 08:58:59.810333 17912 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.819510 16600 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.840765 16430 catalog_manager.cc:5654] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.844872 16524 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:58:59.977767 18041 ts_tablet_manager.cc:933] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:58:59.979763 18041 tablet_copy_client.cc:323] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:58:59.981554 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet d51b94b814b049a19e2c94de66731467 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:58:59.982127 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet d51b94b814b049a19e2c94de66731467 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-d51b94b814b049a19e2c94de66731467
I20260204 08:58:59.989452 16541 tablet_copy_source_session.cc:215] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:58:59.992568 18041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51b94b814b049a19e2c94de66731467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:00.006371 18041 tablet_copy_client.cc:806] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:59:00.006939 18041 tablet_copy_client.cc:670] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:59:00.010196 18041 tablet_copy_client.cc:538] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:59:00.017493 18041 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:59:00.039299 18044 ts_tablet_manager.cc:933] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:59:00.041152 18041 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:00.041193 18044 tablet_copy_client.cc:323] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:59:00.042085 18041 tablet_bootstrap.cc:492] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:59:00.042865 18041 ts_tablet_manager.cc:1403] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.026s user 0.018s sys 0.004s
I20260204 08:59:00.043355 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet c4fba286cf394487ab1cf2b45d55835b from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:59:00.043931 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet c4fba286cf394487ab1cf2b45d55835b from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-c4fba286cf394487ab1cf2b45d55835b
I20260204 08:59:00.045542 18041 raft_consensus.cc:359] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:00.046200 18041 raft_consensus.cc:740] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:59:00.046754 18041 consensus_queue.cc:260] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:00.049360 18041 ts_tablet_manager.cc:1434] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260204 08:59:00.051414 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-d51b94b814b049a19e2c94de66731467 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:59:00.051873 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-d51b94b814b049a19e2c94de66731467 on tablet d51b94b814b049a19e2c94de66731467 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:59:00.054702 16691 tablet_copy_source_session.cc:215] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:59:00.060774 18044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fba286cf394487ab1cf2b45d55835b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:00.074632 18044 tablet_copy_client.cc:806] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:59:00.075111 18044 tablet_copy_client.cc:670] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:59:00.078176 18044 tablet_copy_client.cc:538] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:59:00.083333 18041 ts_tablet_manager.cc:933] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:59:00.086346 18044 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:59:00.091703 18041 tablet_copy_client.cc:323] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:59:00.093462 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet fc74f40262504431847cf4419a26b480 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:59:00.093989 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet fc74f40262504431847cf4419a26b480 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-fc74f40262504431847cf4419a26b480
I20260204 08:59:00.104895 16617 tablet_copy_source_session.cc:215] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:59:00.108982 18041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc74f40262504431847cf4419a26b480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:00.114490 18044 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:00.116461 18044 tablet_bootstrap.cc:492] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:59:00.117131 18044 ts_tablet_manager.cc:1403] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.031s user 0.022s sys 0.004s
I20260204 08:59:00.122190 18044 raft_consensus.cc:359] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:00.123065 18044 raft_consensus.cc:740] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:59:00.123716 18044 consensus_queue.cc:260] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:00.126329 18044 ts_tablet_manager.cc:1434] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260204 08:59:00.130095 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-c4fba286cf394487ab1cf2b45d55835b received from {username='slave'} at 127.0.0.1:36626
I20260204 08:59:00.130525 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-c4fba286cf394487ab1cf2b45d55835b on tablet c4fba286cf394487ab1cf2b45d55835b with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:59:00.139777 18041 tablet_copy_client.cc:806] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:59:00.140390 18041 tablet_copy_client.cc:670] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:59:00.144230 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:00.152693 18041 tablet_copy_client.cc:538] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:59:00.160785 18041 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:59:00.191157 18041 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:00.192144 18041 tablet_bootstrap.cc:492] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:59:00.193269 18041 ts_tablet_manager.cc:1403] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.011s
I20260204 08:59:00.195978 18041 raft_consensus.cc:359] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:00.196568 18041 raft_consensus.cc:740] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:59:00.197081 18041 consensus_queue.cc:260] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:00.199096 18041 ts_tablet_manager.cc:1434] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260204 08:59:00.200603 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-fc74f40262504431847cf4419a26b480 received from {username='slave'} at 127.0.0.1:38144
I20260204 08:59:00.201056 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-fc74f40262504431847cf4419a26b480 on tablet fc74f40262504431847cf4419a26b480 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:59:00.202045 16674 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d8c54bb34a3c42489cc93960f1717406"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:59:00.202654 16674 raft_consensus.cc:606] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:59:00.204084 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260204 08:59:00.204960 18044 ts_tablet_manager.cc:933] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:59:00.205610 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:00.206300 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:00.253505 18044 tablet_copy_client.cc:323] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:59:00.255103 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet 82c2a342cc8c4de99746b3951b711b0c from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:59:00.255640 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet 82c2a342cc8c4de99746b3951b711b0c from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-82c2a342cc8c4de99746b3951b711b0c
I20260204 08:59:00.263142 16526 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260204 08:59:00.264532 17821 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260204 08:59:00.269052 16691 tablet_copy_source_session.cc:215] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:59:00.269491 16676 raft_consensus.cc:1275] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260204 08:59:00.271441 17821 consensus_queue.cc:1048] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260204 08:59:00.279796 18044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c2a342cc8c4de99746b3951b711b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:00.306145 18044 tablet_copy_client.cc:806] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:59:00.306855 18044 tablet_copy_client.cc:670] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:59:00.310833 18044 tablet_copy_client.cc:538] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:59:00.319625 18044 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:59:00.337803 18044 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:00.338474 18044 tablet_bootstrap.cc:492] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:59:00.338969 18044 ts_tablet_manager.cc:1403] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.020s user 0.019s sys 0.000s
I20260204 08:59:00.341228 18044 raft_consensus.cc:359] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:00.342005 18044 raft_consensus.cc:740] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:59:00.342511 18044 consensus_queue.cc:260] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:00.344347 18044 ts_tablet_manager.cc:1434] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260204 08:59:00.345811 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-82c2a342cc8c4de99746b3951b711b0c received from {username='slave'} at 127.0.0.1:36626
I20260204 08:59:00.346220 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-82c2a342cc8c4de99746b3951b711b0c on tablet 82c2a342cc8c4de99746b3951b711b0c with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:59:00.524780 17252 raft_consensus.cc:1217] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:59:00.532200 17884 raft_consensus.cc:993] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:59:00.532673 18024 raft_consensus.cc:1081] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:59:00.534459 16600 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d8c54bb34a3c42489cc93960f1717406"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57796
I20260204 08:59:00.534965 16600 raft_consensus.cc:493] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:00.535281 16600 raft_consensus.cc:3060] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:00.539122 17252 raft_consensus.cc:1217] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20260204 08:59:00.544376 17252 raft_consensus.cc:1217] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:59:00.544665 16600 raft_consensus.cc:515] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:00.548148 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8c54bb34a3c42489cc93960f1717406" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:59:00.548298 16600 leader_election.cc:290] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:59:00.548651 16673 raft_consensus.cc:3055] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:00.548938 16673 raft_consensus.cc:740] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:59:00.549574 16673 consensus_queue.cc:260] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:00.550463 16673 raft_consensus.cc:3060] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:00.550329 17252 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8c54bb34a3c42489cc93960f1717406" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:59:00.550899 17252 raft_consensus.cc:3060] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:00.556892 16673 raft_consensus.cc:2468] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:59:00.557413 17252 raft_consensus.cc:2468] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:59:00.557967 16572 leader_election.cc:304] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86e16045049f4f87a94336b5d2262328, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:59:00.558893 17706 raft_consensus.cc:2804] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:00.559363 17706 raft_consensus.cc:697] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:59:00.560103 17706 consensus_queue.cc:237] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:00.571537 16427 catalog_manager.cc:5654] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:00.659574 17252 raft_consensus.cc:1217] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:59:00.966789 16673 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:59:00.968214 18021 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:59:00.981277 17252 raft_consensus.cc:1275] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:59:00.982829 17706 consensus_queue.cc:1048] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:59:01.011533 17706 raft_consensus.cc:1064] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:59:01.013646 17706 consensus_queue.cc:237] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.025395 16674 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260204 08:59:01.025831 16526 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260204 08:59:01.027194 18021 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:59:01.027456 17252 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260204 08:59:01.028767 18019 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:59:01.030754 17706 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:59:01.040988 18019 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.042487 16673 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.044870 16526 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.049881 17912 raft_consensus.cc:1064] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:59:01.052130 17912 consensus_queue.cc:237] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.052023 17252 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.059762 16430 catalog_manager.cc:5654] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 4 to 5, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:59:01.069207 17252 raft_consensus.cc:1275] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.069803 16600 raft_consensus.cc:1275] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.080199 16600 consensus_queue.cc:237] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.086755 18073 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:01.090965 17252 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260204 08:59:01.092361 17706 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260204 08:59:01.093657 18073 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260204 08:59:01.095536 17857 raft_consensus.cc:1064] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:59:01.098112 17857 consensus_queue.cc:237] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.099030 16673 raft_consensus.cc:1275] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260204 08:59:01.098628 18066 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.100261 17250 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.104849 18071 raft_consensus.cc:1064] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:59:01.110142 18071 consensus_queue.cc:237] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.104261 16526 raft_consensus.cc:1275] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.117707 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet fc74f40262504431847cf4419a26b480 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:59:01.118850 17706 consensus_queue.cc:1048] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260204 08:59:01.125795 17884 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:01.128659 16673 raft_consensus.cc:2955] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.137600 16430 catalog_manager.cc:5654] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 5 to 6, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 3 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:59:01.147537 17251 raft_consensus.cc:1275] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.148659 17252 raft_consensus.cc:1275] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.149132 16600 raft_consensus.cc:1275] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.150677 17912 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:01.152364 18024 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260204 08:59:01.160387 18071 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.162998 16676 raft_consensus.cc:1275] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.166716 16525 raft_consensus.cc:1275] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.167196 18078 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:01.174798 16603 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.182354 17252 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.189119 18024 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:01.198983 16526 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.202330 16430 catalog_manager.cc:5654] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:59:01.221453 16606 raft_consensus.cc:1275] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:01.221271 18082 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:01.229168 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet fc74f40262504431847cf4419a26b480 with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:55708
I20260204 08:59:01.244128 18078 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:01.252970 18087 tablet_replica.cc:333] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:01.258599 18087 raft_consensus.cc:2243] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:01.261871 18087 raft_consensus.cc:2272] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:01.267580 18087 ts_tablet_manager.cc:1916] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:59:01.262154 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:01.296413 18054 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.297880 16603 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.299449 18024 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.305555 17250 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.308204 17251 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.319814 16674 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.322177 16427 catalog_manager.cc:5654] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.330076 16429 catalog_manager.cc:5654] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:59:01.338516 16525 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.331346 16673 consensus_queue.cc:237] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.361661 18087 ts_tablet_manager.cc:1929] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260204 08:59:01.361706 17251 raft_consensus.cc:1275] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:01.362187 18087 log.cc:1199] T fc74f40262504431847cf4419a26b480 P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/fc74f40262504431847cf4419a26b480
I20260204 08:59:01.364254 17912 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:01.365381 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet fc74f40262504431847cf4419a26b480 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:59:01.358770 16603 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.369205 16600 raft_consensus.cc:1275] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:01.372469 17912 consensus_queue.cc:1048] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:01.370790 16526 consensus_queue.cc:237] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.375361 16676 consensus_queue.cc:237] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.383111 16606 raft_consensus.cc:1275] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:01.382921 17251 raft_consensus.cc:1275] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:01.384073 18073 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.386480 16525 raft_consensus.cc:1275] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:01.387413 17912 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:01.390126 18054 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260204 08:59:01.393216 18078 consensus_queue.cc:1048] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:01.395809 17252 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.397022 16606 raft_consensus.cc:2955] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.401862 18076 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.395949 17250 raft_consensus.cc:1275] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:01.404376 17253 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.408398 18072 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.409673 16524 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.411514 18071 consensus_queue.cc:1048] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:01.421857 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 82c2a342cc8c4de99746b3951b711b0c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:59:01.423476 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c4fba286cf394487ab1cf2b45d55835b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:59:01.432137 16600 raft_consensus.cc:2955] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.421346 17251 raft_consensus.cc:2955] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.434975 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d51b94b814b049a19e2c94de66731467 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:59:01.438131 16430 catalog_manager.cc:5654] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.442314 16427 catalog_manager.cc:5654] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.456830 16599 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:59:01.457379 16599 raft_consensus.cc:606] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Received request to transfer leadership to TS 86e16045049f4f87a94336b5d2262328
I20260204 08:59:01.458994 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260204 08:59:01.461063 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:01.461724 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:01.463812 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet d51b94b814b049a19e2c94de66731467 with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:59:01.481027 18090 tablet_replica.cc:333] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:01.482049 18090 raft_consensus.cc:2243] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:01.482723 18090 raft_consensus.cc:2272] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:01.486364 18090 ts_tablet_manager.cc:1916] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:59:01.490073 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet c4fba286cf394487ab1cf2b45d55835b with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:59:01.488958 16428 catalog_manager.cc:5654] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:01.497622 18091 tablet_replica.cc:333] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:01.513088 18090 ts_tablet_manager.cc:1929] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:59:01.513662 18090 log.cc:1199] T d51b94b814b049a19e2c94de66731467 P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/d51b94b814b049a19e2c94de66731467
I20260204 08:59:01.514005 16520 tablet_service.cc:1552] Processing DeleteTablet for tablet 82c2a342cc8c4de99746b3951b711b0c with delete_type TABLET_DATA_TOMBSTONED (TS 35380a227e2c4fa4a063d4fd67c30b53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55708
I20260204 08:59:01.515523 18087 tablet_replica.cc:333] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:01.502861 18091 raft_consensus.cc:2243] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:01.521790 18091 raft_consensus.cc:2272] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:01.527266 18087 raft_consensus.cc:2243] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:01.527962 18087 raft_consensus.cc:2272] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:01.532723 18087 ts_tablet_manager.cc:1916] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:59:01.537782 18091 ts_tablet_manager.cc:1916] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:59:01.515383 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet d51b94b814b049a19e2c94de66731467 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:59:01.545569 18087 ts_tablet_manager.cc:1929] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:59:01.546145 18087 log.cc:1199] T 82c2a342cc8c4de99746b3951b711b0c P 35380a227e2c4fa4a063d4fd67c30b53: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/wals/82c2a342cc8c4de99746b3951b711b0c
I20260204 08:59:01.547816 16416 catalog_manager.cc:4985] TS 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): tablet 82c2a342cc8c4de99746b3951b711b0c (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:59:01.556934 18091 ts_tablet_manager.cc:1929] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:59:01.557309 18091 log.cc:1199] T c4fba286cf394487ab1cf2b45d55835b P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/c4fba286cf394487ab1cf2b45d55835b
I20260204 08:59:01.558624 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet c4fba286cf394487ab1cf2b45d55835b (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:59:01.860632 18021 raft_consensus.cc:993] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:59:01.861106 17706 raft_consensus.cc:1081] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Signalling peer 86e16045049f4f87a94336b5d2262328 to start an election
I20260204 08:59:01.862316 16673 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
from {username='slave'} at 127.0.0.1:40262
I20260204 08:59:01.862846 16673 raft_consensus.cc:493] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:01.863102 16673 raft_consensus.cc:3060] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:01.867156 16673 raft_consensus.cc:515] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.868364 16673 leader_election.cc:290] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281)
I20260204 08:59:01.869063 16600 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:59:01.869212 17251 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b534820859442b49b61eb04ce7e2363" candidate_uuid: "86e16045049f4f87a94336b5d2262328" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
I20260204 08:59:01.869599 16600 raft_consensus.cc:3055] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:01.869650 17251 raft_consensus.cc:3060] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:01.869874 16600 raft_consensus.cc:740] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:59:01.870497 16600 consensus_queue.cc:260] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.871306 16600 raft_consensus.cc:3060] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:01.873754 17251 raft_consensus.cc:2468] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:59:01.874711 16647 leader_election.cc:304] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, 86e16045049f4f87a94336b5d2262328; no voters:
I20260204 08:59:01.875077 16600 raft_consensus.cc:2468] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e16045049f4f87a94336b5d2262328 in term 2.
I20260204 08:59:01.876081 18024 raft_consensus.cc:2804] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:01.876506 18024 raft_consensus.cc:697] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Becoming Leader. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:59:01.877269 18024 consensus_queue.cc:237] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:01.887001 16429 catalog_manager.cc:5654] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 reported cstate change: term changed from 1 to 2, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 86e16045049f4f87a94336b5d2262328 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:02.451538 16603 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:59:02.452767 18072 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:59:02.466096 17252 raft_consensus.cc:1275] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260204 08:59:02.467760 18072 consensus_queue.cc:1048] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:59:02.537367 16603 consensus_queue.cc:237] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:02.542965 16673 raft_consensus.cc:1275] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:59:02.543485 16526 raft_consensus.cc:1275] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:59:02.544170 18021 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:02.545697 18093 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:59:02.546509 16573 consensus_peers.cc:597] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06e4fe1636ad4bb8bbdbeb6009a8d41d. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:02.550002 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:02.556870 18093 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.560803 16524 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.561838 16673 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.574522 16429 catalog_manager.cc:5654] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.603945 16673 consensus_queue.cc:237] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:02.613801 16526 raft_consensus.cc:1275] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260204 08:59:02.615684 16647 consensus_peers.cc:597] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4a8c1585bad41eb94f02214a751600b. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:02.616263 16603 raft_consensus.cc:1275] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:59:02.617209 18072 consensus_queue.cc:1048] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:02.617985 18073 consensus_queue.cc:1048] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:02.624441 16673 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c"
dest_uuid: "86e16045049f4f87a94336b5d2262328"
mode: GRACEFUL
new_leader_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:43702
I20260204 08:59:02.625072 16673 raft_consensus.cc:606] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Received request to transfer leadership to TS f959652a42f34a81aca5da9faec0a7a3
I20260204 08:59:02.626348 18024 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.627468 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260204 08:59:02.627640 16603 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.629143 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:02.629781 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:02.631161 16526 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.641517 16524 consensus_queue.cc:237] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:02.648181 16427 catalog_manager.cc:5654] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
W20260204 08:59:02.702870 16498 consensus_peers.cc:597] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 -> Peer 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196:33281): Couldn't send request to peer 6e58e6edfb3b43b1b5378f9e9a26e842. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be0afba4e5c14c95870971bc8c2c7225. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:02.703451 16603 raft_consensus.cc:1275] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:59:02.704236 16673 raft_consensus.cc:1275] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 08:59:02.706172 18076 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:02.708094 18054 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:02.716919 18110 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.718246 16673 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.720724 16600 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
I20260204 08:59:02.732497 16427 catalog_manager.cc:5654] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 reported cstate change: config changed from index -1 to 2, NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) added. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } } }
W20260204 08:59:02.740373 16478 auto_rebalancer.cc:256] failed to send replica move request: Remote error: Service unavailable: leader transfer in progress
W20260204 08:59:02.753958 16478 auto_rebalancer.cc:726] Could not move replica: Incomplete: tablet f832ab776a0c43a4972fba456498de8c, TS 35380a227e2c4fa4a063d4fd67c30b53 -> TS 6e58e6edfb3b43b1b5378f9e9a26e842 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
W20260204 08:59:02.754274 16478 auto_rebalancer.cc:266] scheduled replica move failed to complete: Incomplete: tablet f832ab776a0c43a4972fba456498de8c, TS 35380a227e2c4fa4a063d4fd67c30b53 -> TS 6e58e6edfb3b43b1b5378f9e9a26e842 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:59:03.021791 18024 raft_consensus.cc:993] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328: : Instructing follower f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:59:03.022354 18073 raft_consensus.cc:1081] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Signalling peer f959652a42f34a81aca5da9faec0a7a3 to start an election
I20260204 08:59:03.023603 16600 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
from {username='slave'} at 127.0.0.1:57796
I20260204 08:59:03.024120 16600 raft_consensus.cc:493] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:03.024439 16600 raft_consensus.cc:3060] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:03.032275 16600 raft_consensus.cc:515] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:59:03.033890 16600 leader_election.cc:290] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Requested vote from peers 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:59:03.034685 16525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35380a227e2c4fa4a063d4fd67c30b53"
I20260204 08:59:03.035254 16525 raft_consensus.cc:3060] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:03.035176 16673 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f832ab776a0c43a4972fba456498de8c" candidate_uuid: "f959652a42f34a81aca5da9faec0a7a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:59:03.035741 16673 raft_consensus.cc:3055] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:03.036052 16673 raft_consensus.cc:740] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86e16045049f4f87a94336b5d2262328, State: Running, Role: LEADER
I20260204 08:59:03.036693 16673 consensus_queue.cc:260] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:59:03.037894 16673 raft_consensus.cc:3060] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:03.041805 16525 raft_consensus.cc:2468] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:59:03.042910 16572 leader_election.cc:304] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35380a227e2c4fa4a063d4fd67c30b53, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:59:03.043704 18093 raft_consensus.cc:2804] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:03.044008 16673 raft_consensus.cc:2468] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f959652a42f34a81aca5da9faec0a7a3 in term 2.
I20260204 08:59:03.044157 18093 raft_consensus.cc:697] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Leader. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:59:03.044915 18093 consensus_queue.cc:237] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } }
I20260204 08:59:03.055887 16428 catalog_manager.cc:5654] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: term changed from 1 to 2, leader changed from 86e16045049f4f87a94336b5d2262328 (127.15.3.195) to f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:03.057685 18114 ts_tablet_manager.cc:933] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:59:03.059367 18114 tablet_copy_client.cc:323] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.195:39491
I20260204 08:59:03.060786 16691 tablet_copy_service.cc:140] P 86e16045049f4f87a94336b5d2262328: Received BeginTabletCopySession request for tablet b4a8c1585bad41eb94f02214a751600b from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:36626)
I20260204 08:59:03.061198 16691 tablet_copy_service.cc:161] P 86e16045049f4f87a94336b5d2262328: Beginning new tablet copy session on tablet b4a8c1585bad41eb94f02214a751600b from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:36626: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-b4a8c1585bad41eb94f02214a751600b
I20260204 08:59:03.068053 16691 tablet_copy_source_session.cc:215] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:59:03.070776 18114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a8c1585bad41eb94f02214a751600b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:03.086118 18114 tablet_copy_client.cc:806] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:59:03.086649 18114 tablet_copy_client.cc:670] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:59:03.101536 18114 tablet_copy_client.cc:538] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:59:03.112253 18116 ts_tablet_manager.cc:933] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621)
I20260204 08:59:03.113181 18114 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:59:03.145073 18114 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:03.146080 18114 tablet_bootstrap.cc:492] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:59:03.146775 18114 ts_tablet_manager.cc:1403] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.034s user 0.015s sys 0.010s
I20260204 08:59:03.153069 18114 raft_consensus.cc:359] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:03.153885 18114 raft_consensus.cc:740] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:59:03.153746 18116 tablet_copy_client.cc:323] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.193:39621
I20260204 08:59:03.154433 18114 consensus_queue.cc:260] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:03.159199 16541 tablet_copy_service.cc:140] P 35380a227e2c4fa4a063d4fd67c30b53: Received BeginTabletCopySession request for tablet be0afba4e5c14c95870971bc8c2c7225 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:45256)
I20260204 08:59:03.159749 16541 tablet_copy_service.cc:161] P 35380a227e2c4fa4a063d4fd67c30b53: Beginning new tablet copy session on tablet be0afba4e5c14c95870971bc8c2c7225 from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:45256: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-be0afba4e5c14c95870971bc8c2c7225
I20260204 08:59:03.162379 18120 ts_tablet_manager.cc:933] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: Initiating tablet copy from peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667)
I20260204 08:59:03.164274 18120 tablet_copy_client.cc:323] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Beginning tablet copy session from remote peer at address 127.15.3.194:42667
I20260204 08:59:03.167289 16617 tablet_copy_service.cc:140] P f959652a42f34a81aca5da9faec0a7a3: Received BeginTabletCopySession request for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d from peer 6e58e6edfb3b43b1b5378f9e9a26e842 ({username='slave'} at 127.0.0.1:38144)
I20260204 08:59:03.167735 16617 tablet_copy_service.cc:161] P f959652a42f34a81aca5da9faec0a7a3: Beginning new tablet copy session on tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d from peer 6e58e6edfb3b43b1b5378f9e9a26e842 at {username='slave'} at 127.0.0.1:38144: session id = 6e58e6edfb3b43b1b5378f9e9a26e842-06e4fe1636ad4bb8bbdbeb6009a8d41d
I20260204 08:59:03.169471 16541 tablet_copy_source_session.cc:215] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:59:03.169179 18114 ts_tablet_manager.cc:1434] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.022s user 0.003s sys 0.001s
I20260204 08:59:03.172557 18116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0afba4e5c14c95870971bc8c2c7225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:03.179200 16691 tablet_copy_service.cc:342] P 86e16045049f4f87a94336b5d2262328: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-b4a8c1585bad41eb94f02214a751600b received from {username='slave'} at 127.0.0.1:36626
I20260204 08:59:03.179584 16691 tablet_copy_service.cc:434] P 86e16045049f4f87a94336b5d2262328: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-b4a8c1585bad41eb94f02214a751600b on tablet b4a8c1585bad41eb94f02214a751600b with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:59:03.184259 16617 tablet_copy_source_session.cc:215] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260204 08:59:03.192847 18120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:03.197570 18116 tablet_copy_client.cc:806] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:59:03.198169 18116 tablet_copy_client.cc:670] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:59:03.202056 18116 tablet_copy_client.cc:538] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:59:03.207605 18120 tablet_copy_client.cc:806] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 0 data blocks...
I20260204 08:59:03.208117 18120 tablet_copy_client.cc:670] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Starting download of 1 WAL segments...
I20260204 08:59:03.211387 18120 tablet_copy_client.cc:538] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260204 08:59:03.212227 18116 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:59:03.222874 18120 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap starting.
I20260204 08:59:03.233850 18116 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:03.234717 18116 tablet_bootstrap.cc:492] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:59:03.235471 18116 ts_tablet_manager.cc:1403] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.006s
I20260204 08:59:03.238241 18116 raft_consensus.cc:359] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:03.239048 18116 raft_consensus.cc:740] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:59:03.239756 18116 consensus_queue.cc:260] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:03.243767 18120 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:03.244683 18120 tablet_bootstrap.cc:492] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: Bootstrap complete.
I20260204 08:59:03.244805 18116 ts_tablet_manager.cc:1434] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260204 08:59:03.245345 18120 ts_tablet_manager.cc:1403] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent bootstrapping tablet: real 0.023s user 0.021s sys 0.000s
I20260204 08:59:03.247624 16541 tablet_copy_service.cc:342] P 35380a227e2c4fa4a063d4fd67c30b53: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-be0afba4e5c14c95870971bc8c2c7225 received from {username='slave'} at 127.0.0.1:45256
I20260204 08:59:03.248122 16541 tablet_copy_service.cc:434] P 35380a227e2c4fa4a063d4fd67c30b53: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-be0afba4e5c14c95870971bc8c2c7225 on tablet be0afba4e5c14c95870971bc8c2c7225 with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:59:03.248399 18120 raft_consensus.cc:359] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:03.249624 18120 raft_consensus.cc:740] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Initialized, Role: LEARNER
I20260204 08:59:03.251684 18120 consensus_queue.cc:260] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: NON_VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: true } }
I20260204 08:59:03.254598 18120 ts_tablet_manager.cc:1434] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260204 08:59:03.257004 16617 tablet_copy_service.cc:342] P f959652a42f34a81aca5da9faec0a7a3: Request end of tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-06e4fe1636ad4bb8bbdbeb6009a8d41d received from {username='slave'} at 127.0.0.1:38144
I20260204 08:59:03.257402 16617 tablet_copy_service.cc:434] P f959652a42f34a81aca5da9faec0a7a3: ending tablet copy session 6e58e6edfb3b43b1b5378f9e9a26e842-06e4fe1636ad4bb8bbdbeb6009a8d41d on tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d with peer 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:59:03.440241 17252 raft_consensus.cc:1217] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:59:03.474345 17252 raft_consensus.cc:1217] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:59:03.543068 16673 raft_consensus.cc:1275] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:03.544122 17706 consensus_queue.cc:1048] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:03.558149 16525 raft_consensus.cc:1275] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:03.559996 17706 consensus_queue.cc:1048] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:03.686127 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:03.732651 17252 raft_consensus.cc:1217] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260204 08:59:03.731861 16600 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "12675d44700947d9871774efc58a8b70"
dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
mode: GRACEFUL
new_leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:50354
I20260204 08:59:03.735612 16600 raft_consensus.cc:606] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Received request to transfer leadership to TS 6e58e6edfb3b43b1b5378f9e9a26e842
I20260204 08:59:03.737305 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260204 08:59:03.738770 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:03.739370 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:03.814867 18129 raft_consensus.cc:993] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3: : Instructing follower 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:59:03.815361 18093 raft_consensus.cc:1081] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Signalling peer 6e58e6edfb3b43b1b5378f9e9a26e842 to start an election
I20260204 08:59:03.816605 17252 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "12675d44700947d9871774efc58a8b70"
dest_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842"
from {username='slave'} at 127.0.0.1:41580
I20260204 08:59:03.817055 17252 raft_consensus.cc:493] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:03.817371 17252 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:03.823241 17252 raft_consensus.cc:515] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:03.824800 17252 leader_election.cc:290] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 3 election: Requested vote from peers f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667), 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491)
I20260204 08:59:03.825449 16603 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f959652a42f34a81aca5da9faec0a7a3"
I20260204 08:59:03.826013 16603 raft_consensus.cc:3055] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:03.826299 16603 raft_consensus.cc:740] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f959652a42f34a81aca5da9faec0a7a3, State: Running, Role: LEADER
I20260204 08:59:03.826936 16603 consensus_queue.cc:260] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:03.828032 16603 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:03.833611 16603 raft_consensus.cc:2468] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 3.
I20260204 08:59:03.834431 16676 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12675d44700947d9871774efc58a8b70" candidate_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "86e16045049f4f87a94336b5d2262328"
I20260204 08:59:03.834484 17219 leader_election.cc:304] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e58e6edfb3b43b1b5378f9e9a26e842, f959652a42f34a81aca5da9faec0a7a3; no voters:
I20260204 08:59:03.835270 18118 raft_consensus.cc:2804] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:03.835713 18118 raft_consensus.cc:697] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 LEADER]: Becoming Leader. State: Replica: 6e58e6edfb3b43b1b5378f9e9a26e842, State: Running, Role: LEADER
I20260204 08:59:03.835309 16676 raft_consensus.cc:3060] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:03.836445 18118 consensus_queue.cc:237] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:03.841439 16676 raft_consensus.cc:2468] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e58e6edfb3b43b1b5378f9e9a26e842 in term 3.
I20260204 08:59:03.848368 16429 catalog_manager.cc:5654] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: term changed from 2 to 3, leader changed from f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) to 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196). New cstate: current_term: 3 leader_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:59:04.012253 18076 raft_consensus.cc:1064] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:59:04.015401 18076 consensus_queue.cc:237] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:04.021566 17252 raft_consensus.cc:1275] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.021741 16673 raft_consensus.cc:1275] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.023177 18110 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:04.031251 18072 raft_consensus.cc:1064] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:59:04.031728 18076 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:04.033860 18072 consensus_queue.cc:237] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:04.055851 16600 raft_consensus.cc:1275] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.063402 17251 raft_consensus.cc:1275] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.065418 18076 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:04.069695 16600 raft_consensus.cc:1275] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.069695 18134 consensus_queue.cc:1048] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260204 08:59:04.073096 18140 consensus_queue.cc:1048] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:04.084857 16524 raft_consensus.cc:1275] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.087109 18134 consensus_queue.cc:1048] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:04.091370 18137 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.102761 16674 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.103415 18134 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.105295 17251 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.112931 17250 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.117416 16429 catalog_manager.cc:5654] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:59:04.125943 16428 catalog_manager.cc:5654] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.129094 16600 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.135478 16524 consensus_queue.cc:237] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:04.151291 16603 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.153447 17250 raft_consensus.cc:1275] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:04.154821 16524 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } attrs { replace: true } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.156493 18110 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:59:04.173030 18093 raft_consensus.cc:1064] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3: attempting to promote NON_VOTER 6e58e6edfb3b43b1b5378f9e9a26e842 to VOTER
I20260204 08:59:04.174059 16673 raft_consensus.cc:1275] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer 35380a227e2c4fa4a063d4fd67c30b53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:04.175534 18093 consensus_queue.cc:237] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:04.177881 18110 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.182054 17252 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.185684 18076 consensus_queue.cc:1048] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:04.194869 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet be0afba4e5c14c95870971bc8c2c7225 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:59:04.196713 16673 raft_consensus.cc:2955] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.216820 16427 catalog_manager.cc:5654] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "35380a227e2c4fa4a063d4fd67c30b53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.225217 16674 raft_consensus.cc:1275] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.226392 17706 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:04.226770 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet be0afba4e5c14c95870971bc8c2c7225 with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:59:04.227144 16603 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260204 08:59:04.228253 17252 raft_consensus.cc:1275] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 LEARNER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.230346 17713 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260204 08:59:04.232313 16524 raft_consensus.cc:1275] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 08:59:04.233088 18129 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:04.237124 18129 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:04.244926 16674 raft_consensus.cc:1275] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Refusing update from remote peer 6e58e6edfb3b43b1b5378f9e9a26e842: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260204 08:59:04.246529 17713 consensus_queue.cc:1048] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260204 08:59:04.247769 16674 consensus_queue.cc:237] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:04.251324 18150 tablet_replica.cc:333] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:04.254408 16525 raft_consensus.cc:1275] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:04.255201 18150 raft_consensus.cc:2243] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.256198 18150 raft_consensus.cc:2272] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.257174 18072 consensus_queue.cc:1048] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:04.263592 18150 ts_tablet_manager.cc:1916] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:59:04.264714 18140 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.274183 17252 raft_consensus.cc:1275] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer 86e16045049f4f87a94336b5d2262328: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:04.276700 18072 consensus_queue.cc:1048] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:04.281394 17251 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.286306 18150 ts_tablet_manager.cc:1929] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:59:04.286876 18150 log.cc:1199] T be0afba4e5c14c95870971bc8c2c7225 P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/be0afba4e5c14c95870971bc8c2c7225
I20260204 08:59:04.288736 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet be0afba4e5c14c95870971bc8c2c7225 (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:59:04.296372 16525 raft_consensus.cc:2955] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.315892 16416 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet b4a8c1585bad41eb94f02214a751600b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:59:04.318133 18093 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.320158 17252 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.324421 16429 catalog_manager.cc:5654] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 3 to 4, VOTER f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194) evicted. New cstate: current_term: 1 leader_uuid: "86e16045049f4f87a94336b5d2262328" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.334280 16596 tablet_service.cc:1552] Processing DeleteTablet for tablet b4a8c1585bad41eb94f02214a751600b with delete_type TABLET_DATA_TOMBSTONED (TS f959652a42f34a81aca5da9faec0a7a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57776
I20260204 08:59:04.335415 18150 tablet_replica.cc:333] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:04.337019 18150 raft_consensus.cc:2243] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.337800 18150 raft_consensus.cc:2272] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.343497 18150 ts_tablet_manager.cc:1916] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:59:04.343303 16429 catalog_manager.cc:5654] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 reported cstate change: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.348647 16525 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.356269 16673 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6e58e6edfb3b43b1b5378f9e9a26e842 (127.15.3.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "86e16045049f4f87a94336b5d2262328" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 39491 } attrs { replace: true } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.377259 18150 ts_tablet_manager.cc:1929] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:59:04.377810 18150 log.cc:1199] T b4a8c1585bad41eb94f02214a751600b P f959652a42f34a81aca5da9faec0a7a3: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/wals/b4a8c1585bad41eb94f02214a751600b
I20260204 08:59:04.379196 16417 catalog_manager.cc:4985] TS f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): tablet b4a8c1585bad41eb94f02214a751600b (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:59:04.384339 16600 consensus_queue.cc:237] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } }
I20260204 08:59:04.399562 17252 raft_consensus.cc:1275] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:04.401239 18093 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:04.418644 16525 raft_consensus.cc:1275] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Refusing update from remote peer f959652a42f34a81aca5da9faec0a7a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260204 08:59:04.414634 18129 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.422941 17252 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.430651 18093 consensus_queue.cc:1048] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:04.435021 16417 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260204 08:59:04.437435 16524 raft_consensus.cc:2955] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } } }
I20260204 08:59:04.454223 16427 catalog_manager.cc:5654] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 reported cstate change: config changed from index 3 to 4, VOTER 86e16045049f4f87a94336b5d2262328 (127.15.3.195) evicted. New cstate: current_term: 1 leader_uuid: "f959652a42f34a81aca5da9faec0a7a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "35380a227e2c4fa4a063d4fd67c30b53" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 39621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f959652a42f34a81aca5da9faec0a7a3" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 42667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e58e6edfb3b43b1b5378f9e9a26e842" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33281 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260204 08:59:04.463340 16663 tablet_service.cc:1552] Processing DeleteTablet for tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d with delete_type TABLET_DATA_TOMBSTONED (TS 86e16045049f4f87a94336b5d2262328 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40258
I20260204 08:59:04.465276 18163 tablet_replica.cc:333] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:04.466398 18163 raft_consensus.cc:2243] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.467051 18163 raft_consensus.cc:2272] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.469549 18163 ts_tablet_manager.cc:1916] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260204 08:59:04.481702 18163 ts_tablet_manager.cc:1929] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260204 08:59:04.482012 18163 log.cc:1199] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 86e16045049f4f87a94336b5d2262328: Deleting WAL directory at /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/wals/06e4fe1636ad4bb8bbdbeb6009a8d41d
I20260204 08:59:04.483209 16416 catalog_manager.cc:4985] TS 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): tablet 06e4fe1636ad4bb8bbdbeb6009a8d41d (table test-workload [id=15f74ce0f0594e9285f208e67bcc1963]) successfully deleted
I20260204 08:59:04.783087 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:04.815294 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260204 08:59:04.816992 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:04.817564 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:04.846907 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:04.881865 15375 tablet_server.cc:178] TabletServer@127.15.3.193:0 shutting down...
W20260204 08:59:04.892760 17218 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260204 08:59:04.897926 17218 consensus_peers.cc:597] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:04.901284 16572 consensus_peers.cc:597] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:04.934783 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:59:04.935489 15375 tablet_replica.cc:333] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.936069 15375 raft_consensus.cc:2243] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.936654 15375 raft_consensus.cc:2272] T 8689b3435b4f43a1b5a8c5af26f23c2c P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.938879 15375 tablet_replica.cc:333] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.939594 15375 raft_consensus.cc:2243] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.940150 15375 raft_consensus.cc:2272] T c4fba286cf394487ab1cf2b45d55835b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.942097 15375 tablet_replica.cc:333] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.942817 15375 raft_consensus.cc:2243] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.943234 15375 raft_consensus.cc:2272] T a2372d97d9af497ea9e6782d61032982 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.945451 15375 tablet_replica.cc:333] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.946177 15375 raft_consensus.cc:2243] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.946689 15375 raft_consensus.cc:2272] T 801ee654117f4d37b4ad0c66b46fd4e4 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.949133 15375 tablet_replica.cc:333] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.949827 15375 raft_consensus.cc:2243] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.950314 15375 raft_consensus.cc:2272] T f832ab776a0c43a4972fba456498de8c P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.952562 15375 tablet_replica.cc:333] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.953301 15375 raft_consensus.cc:2243] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:04.954191 15375 raft_consensus.cc:2272] T 35fde83161df49e09eb28ee05a4ad35f P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.956878 15375 tablet_replica.cc:333] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.957633 15375 raft_consensus.cc:2243] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.958282 15375 raft_consensus.cc:2272] T 796b324679b4492db7f68598b0a2d4e2 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.963049 15375 tablet_replica.cc:333] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
W20260204 08:59:04.963635 17218 consensus_peers.cc:597] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:04.963807 15375 raft_consensus.cc:2243] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.964378 15375 raft_consensus.cc:2272] T 3fd60f400d0147959fa060cf8359ae32 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:04.965919 17218 consensus_peers.cc:597] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:04.966789 15375 tablet_replica.cc:333] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.967695 15375 raft_consensus.cc:2243] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.968230 15375 raft_consensus.cc:2272] T 61ec06ad82864d3a91228c325fd1af2d P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.970703 15375 tablet_replica.cc:333] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
W20260204 08:59:04.971068 16572 consensus_peers.cc:597] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:04.971436 15375 raft_consensus.cc:2243] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.972096 15375 raft_consensus.cc:2272] T d7f0ef5121b748d18bbd7783a318fbc7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.974308 15375 tablet_replica.cc:333] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.975059 15375 raft_consensus.cc:2243] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.975634 15375 raft_consensus.cc:2272] T 457a55a8c34648f6ae2a009fcb9fd749 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.978184 15375 tablet_replica.cc:333] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.978940 15375 raft_consensus.cc:2243] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.979415 15375 raft_consensus.cc:2272] T 569b49ee7fc94d7bab7861620dbccfed P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.981613 15375 tablet_replica.cc:333] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.982342 15375 raft_consensus.cc:2243] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.982925 15375 raft_consensus.cc:2272] T 376fb0bb77c04a0d9daf4939af20207f P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.985615 15375 tablet_replica.cc:333] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.986358 15375 raft_consensus.cc:2243] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.986914 15375 raft_consensus.cc:2272] T a2c39bf3d0c849a1aa4ef353e0e67991 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.989300 15375 tablet_replica.cc:333] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.989940 15375 raft_consensus.cc:2243] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:04.990813 15375 raft_consensus.cc:2272] T a2e4ca7bedb84f7ba570333f98fb5de5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.993193 15375 tablet_replica.cc:333] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.993919 15375 raft_consensus.cc:2243] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:04.994424 15375 raft_consensus.cc:2272] T b4a8f14fd5174a4d98b1849c67325173 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:04.996878 15375 tablet_replica.cc:333] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:04.997540 15375 raft_consensus.cc:2243] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:04.998468 15375 raft_consensus.cc:2272] T aa4d147d1fb14e6ca905000e39085dfa P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:04.998955 16646 consensus_peers.cc:597] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.000183 16646 consensus_peers.cc:597] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.000928 15375 tablet_replica.cc:333] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
W20260204 08:59:05.001291 16572 consensus_peers.cc:597] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.001859 15375 raft_consensus.cc:2243] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.002494 15375 raft_consensus.cc:2272] T d51b94b814b049a19e2c94de66731467 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.004293 15375 tablet_replica.cc:333] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.004792 15375 raft_consensus.cc:2243] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.005121 15375 raft_consensus.cc:2272] T aac4f009108d4057aee3fb4274b6d320 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.006982 15375 tablet_replica.cc:333] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.007516 15375 raft_consensus.cc:2243] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.007994 15375 raft_consensus.cc:2272] T 91a7c7c248c04840817bf3090ca01597 P 35380a227e2c4fa4a063d4fd67c30b53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.010026 15375 tablet_replica.cc:333] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.010610 15375 raft_consensus.cc:2243] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.011546 15375 raft_consensus.cc:2272] T 56a1c6e078b242738f19a73c490d3830 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.012615 16572 consensus_peers.cc:597] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.013736 15375 tablet_replica.cc:333] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.014394 15375 raft_consensus.cc:2243] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
W20260204 08:59:05.014611 16572 consensus_peers.cc:597] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.015111 15375 raft_consensus.cc:2272] T 72c4736a5d244206a366cb1166df369e P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.017053 15375 tablet_replica.cc:333] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.017737 15375 raft_consensus.cc:2243] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.018209 15375 raft_consensus.cc:2272] T 0081bf9327d5467897615fd29a2a5ad6 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.020500 15375 tablet_replica.cc:333] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.021210 15375 raft_consensus.cc:2243] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.022127 15375 raft_consensus.cc:2272] T 232077fdd4b44876ba13c53b7f42f888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.024573 15375 tablet_replica.cc:333] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.025287 15375 raft_consensus.cc:2243] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.025791 15375 raft_consensus.cc:2272] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.028286 15375 tablet_replica.cc:333] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.028945 15375 raft_consensus.cc:2243] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.029457 15375 raft_consensus.cc:2272] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.033214 15375 tablet_replica.cc:333] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.033947 15375 raft_consensus.cc:2243] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.034686 15375 raft_consensus.cc:2272] T b4a8c1585bad41eb94f02214a751600b P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.037950 15375 tablet_replica.cc:333] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.038817 15375 raft_consensus.cc:2243] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.039533 15375 raft_consensus.cc:2272] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.041865 15375 tablet_replica.cc:333] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.042512 15375 raft_consensus.cc:2243] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
W20260204 08:59:05.042742 17218 consensus_peers.cc:597] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.043431 15375 raft_consensus.cc:2272] T 29067ae5902a405283277bb95a626f04 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.045951 15375 tablet_replica.cc:333] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.046643 15375 raft_consensus.cc:2243] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.047575 15375 raft_consensus.cc:2272] T be0afba4e5c14c95870971bc8c2c7225 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.050127 15375 tablet_replica.cc:333] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.050753 15375 raft_consensus.cc:2243] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.051482 15375 raft_consensus.cc:2272] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.053603 15375 tablet_replica.cc:333] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.054354 15375 raft_consensus.cc:2243] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
W20260204 08:59:05.053536 17218 consensus_peers.cc:597] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.055254 15375 raft_consensus.cc:2272] T 4d0dd5730ea04490876711f04afa95e5 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.055593 17218 consensus_peers.cc:597] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.057453 16572 consensus_peers.cc:597] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.057854 15375 tablet_replica.cc:333] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.058369 15375 raft_consensus.cc:2243] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.058904 15375 raft_consensus.cc:2272] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.061103 15375 tablet_replica.cc:333] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.061728 15375 raft_consensus.cc:2243] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260204 08:59:05.062119 16646 consensus_peers.cc:597] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.062198 15375 raft_consensus.cc:2272] T e039f673c9814556a561795c68ee2950 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.064491 15375 tablet_replica.cc:333] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
W20260204 08:59:05.064692 17218 consensus_peers.cc:597] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.065007 15375 raft_consensus.cc:2243] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.065838 15375 raft_consensus.cc:2272] T 4773c29a00ab47f9b55fd479ace200e7 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.067281 17218 consensus_peers.cc:597] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.068190 15375 tablet_replica.cc:333] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
W20260204 08:59:05.068660 16572 consensus_peers.cc:597] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.068883 15375 raft_consensus.cc:2243] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.069346 15375 raft_consensus.cc:2272] T 063bb12920e44068a818b00a8573328e P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.071038 15375 tablet_replica.cc:333] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.071518 15375 raft_consensus.cc:2243] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.072256 15375 raft_consensus.cc:2272] T 326778f65c8845f5bc8e4a236d093bfe P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.074214 15375 tablet_replica.cc:333] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.074681 15375 raft_consensus.cc:2243] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.075066 15375 raft_consensus.cc:2272] T 6e3200a486ed4e50b8cd3fbace254888 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.076687 15375 tablet_replica.cc:333] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.077112 15375 raft_consensus.cc:2243] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.077544 15375 raft_consensus.cc:2272] T c77c8d18f5274899a308f09e7aa99de3 P 35380a227e2c4fa4a063d4fd67c30b53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.079077 15375 tablet_replica.cc:333] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.079488 15375 raft_consensus.cc:2243] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.079876 15375 raft_consensus.cc:2272] T 0d2622edd6954367a260d3600443dd26 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.081502 15375 tablet_replica.cc:333] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.082129 15375 raft_consensus.cc:2243] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.082839 15375 raft_consensus.cc:2272] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 35380a227e2c4fa4a063d4fd67c30b53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.084473 15375 tablet_replica.cc:333] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.084905 15375 raft_consensus.cc:2243] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.085265 15375 raft_consensus.cc:2272] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.087080 15375 tablet_replica.cc:333] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.087453 15375 raft_consensus.cc:2243] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.087821 15375 raft_consensus.cc:2272] T 4bff71b9804b47cc915e34b23012509e P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.089285 15375 tablet_replica.cc:333] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.089656 15375 raft_consensus.cc:2243] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.090065 15375 raft_consensus.cc:2272] T 68912efba25745d9ba6be48c71f92a38 P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.091840 15375 tablet_replica.cc:333] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53: stopping tablet replica
I20260204 08:59:05.092223 15375 raft_consensus.cc:2243] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.092885 15375 raft_consensus.cc:2272] T 795715e8aaa1450e811ecebf022fd69b P 35380a227e2c4fa4a063d4fd67c30b53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.102471 16646 consensus_peers.cc:597] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.125108 16572 consensus_peers.cc:597] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.160694 15375 tablet_server.cc:195] TabletServer@127.15.3.193:0 shutdown complete.
W20260204 08:59:05.180864 16646 consensus_peers.cc:597] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.224958 16646 consensus_peers.cc:597] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.246158 15375 tablet_server.cc:178] TabletServer@127.15.3.194:0 shutting down...
W20260204 08:59:05.271258 17219 consensus_peers.cc:597] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.281455 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:59:05.282306 15375 tablet_replica.cc:333] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.283134 15375 raft_consensus.cc:2243] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.283773 15375 raft_consensus.cc:2272] T 3326e90f03344694ace417ed6615d3fa P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.285181 17219 consensus_peers.cc:597] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.286181 15375 tablet_replica.cc:333] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.286803 15375 raft_consensus.cc:2243] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.287312 15375 raft_consensus.cc:2272] T 801ee654117f4d37b4ad0c66b46fd4e4 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.289537 15375 tablet_replica.cc:333] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
W20260204 08:59:05.290057 17218 consensus_peers.cc:597] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.290210 15375 raft_consensus.cc:2243] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.290952 15375 raft_consensus.cc:2272] T 8689b3435b4f43a1b5a8c5af26f23c2c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.292630 15375 tablet_replica.cc:333] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.293283 15375 raft_consensus.cc:2243] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.294056 15375 raft_consensus.cc:2272] T a2372d97d9af497ea9e6782d61032982 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.296023 15375 tablet_replica.cc:333] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.296720 15375 raft_consensus.cc:2243] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.297099 15375 raft_consensus.cc:2272] T 0b534820859442b49b61eb04ce7e2363 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.298899 15375 tablet_replica.cc:333] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.299382 15375 raft_consensus.cc:2243] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.299924 15375 raft_consensus.cc:2272] T 20fa246d3c414fa0b616da38a625bdfe P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.301586 15375 tablet_replica.cc:333] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.302110 15375 raft_consensus.cc:2243] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.302498 15375 raft_consensus.cc:2272] T 35fde83161df49e09eb28ee05a4ad35f P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.304143 15375 tablet_replica.cc:333] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.304644 15375 raft_consensus.cc:2243] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.305152 15375 raft_consensus.cc:2272] T 82c2a342cc8c4de99746b3951b711b0c P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.306699 15375 tablet_replica.cc:333] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.307169 15375 raft_consensus.cc:2243] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.307840 15375 raft_consensus.cc:2272] T c77c8d18f5274899a308f09e7aa99de3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.309442 15375 tablet_replica.cc:333] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.309926 15375 raft_consensus.cc:2243] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.310576 15375 raft_consensus.cc:2272] T 796b324679b4492db7f68598b0a2d4e2 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.312244 16572 consensus_peers.cc:597] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.312319 15375 tablet_replica.cc:333] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.313014 15375 raft_consensus.cc:2243] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.313383 15375 raft_consensus.cc:2272] T 376fb0bb77c04a0d9daf4939af20207f P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.315564 15375 tablet_replica.cc:333] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.316200 15375 raft_consensus.cc:2243] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.316594 15375 raft_consensus.cc:2272] T 92baf1e833884e0b9132f786b6d9791f P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.318467 15375 tablet_replica.cc:333] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.319018 15375 raft_consensus.cc:2243] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.319471 15375 raft_consensus.cc:2272] T 72c4736a5d244206a366cb1166df369e P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.321017 15375 tablet_replica.cc:333] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.321480 15375 raft_consensus.cc:2243] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.321811 15375 raft_consensus.cc:2272] T 56a1c6e078b242738f19a73c490d3830 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.323576 15375 tablet_replica.cc:333] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.324203 15375 raft_consensus.cc:2243] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.324730 15375 raft_consensus.cc:2272] T 61ec06ad82864d3a91228c325fd1af2d P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.326709 15375 tablet_replica.cc:333] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
W20260204 08:59:05.326957 16572 consensus_peers.cc:597] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.327364 15375 raft_consensus.cc:2243] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.327852 15375 raft_consensus.cc:2272] T 4dc53e7c74664efe82fc5edb6dfca943 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.329372 15375 tablet_replica.cc:333] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.329818 15375 raft_consensus.cc:2243] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.330122 15375 raft_consensus.cc:2272] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.331614 15375 tablet_replica.cc:333] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.332126 15375 raft_consensus.cc:2243] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.332737 15375 raft_consensus.cc:2272] T fc74f40262504431847cf4419a26b480 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.334136 15375 tablet_replica.cc:333] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.334570 15375 raft_consensus.cc:2243] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.334900 15375 raft_consensus.cc:2272] T 569b49ee7fc94d7bab7861620dbccfed P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.336326 15375 tablet_replica.cc:333] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.336786 15375 raft_consensus.cc:2243] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.337396 15375 raft_consensus.cc:2272] T f832ab776a0c43a4972fba456498de8c P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.338732 15375 tablet_replica.cc:333] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.339187 15375 raft_consensus.cc:2243] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.339674 15375 raft_consensus.cc:2272] T d51b94b814b049a19e2c94de66731467 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.341056 15375 tablet_replica.cc:333] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.341490 15375 raft_consensus.cc:2243] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.341846 15375 raft_consensus.cc:2272] T aac4f009108d4057aee3fb4274b6d320 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.343320 15375 tablet_replica.cc:333] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.343803 15375 raft_consensus.cc:2243] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.344282 15375 raft_consensus.cc:2272] T b4a8f14fd5174a4d98b1849c67325173 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.345709 15375 tablet_replica.cc:333] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.346139 15375 raft_consensus.cc:2243] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.346762 15375 raft_consensus.cc:2272] T a2c39bf3d0c849a1aa4ef353e0e67991 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.348258 15375 tablet_replica.cc:333] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.348690 15375 raft_consensus.cc:2243] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.349033 15375 raft_consensus.cc:2272] T aa4d147d1fb14e6ca905000e39085dfa P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.351065 15375 tablet_replica.cc:333] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.351696 15375 raft_consensus.cc:2243] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.352160 15375 raft_consensus.cc:2272] T 0f175f5811e74a91b26e6ac39bc9d0b7 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.354279 15375 tablet_replica.cc:333] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.354907 15375 raft_consensus.cc:2243] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Raft consensus shutting down.
W20260204 08:59:05.355198 16647 consensus_peers.cc:597] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.355783 15375 raft_consensus.cc:2272] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.358199 15375 tablet_replica.cc:333] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.358917 15375 raft_consensus.cc:2243] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.359328 15375 raft_consensus.cc:2272] T 3018fb4c08d3462f90e72e4df6d716c8 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.360896 15375 tablet_replica.cc:333] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.361359 15375 raft_consensus.cc:2243] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.362111 15375 raft_consensus.cc:2272] T 0081bf9327d5467897615fd29a2a5ad6 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.364225 15375 tablet_replica.cc:333] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.364877 15375 raft_consensus.cc:2243] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.365332 15375 raft_consensus.cc:2272] T 232077fdd4b44876ba13c53b7f42f888 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.366967 15375 tablet_replica.cc:333] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.367455 15375 raft_consensus.cc:2243] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.367872 15375 raft_consensus.cc:2272] T deb06db695bc4cd7bcef0b6d5f27c3e3 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.369585 15375 tablet_replica.cc:333] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.370014 15375 raft_consensus.cc:2243] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.370330 15375 raft_consensus.cc:2272] T 29067ae5902a405283277bb95a626f04 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.372181 15375 tablet_replica.cc:333] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.372735 15375 raft_consensus.cc:2243] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 4 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.373513 15375 raft_consensus.cc:2272] T 91a7c7c248c04840817bf3090ca01597 P f959652a42f34a81aca5da9faec0a7a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.375797 15375 tablet_replica.cc:333] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
W20260204 08:59:05.375825 16646 consensus_peers.cc:597] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.376536 15375 raft_consensus.cc:2243] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.377192 15375 raft_consensus.cc:2272] T e6a3887aa0f64b1a8d49dc7e0e061459 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.378350 17219 consensus_peers.cc:597] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.379189 15375 tablet_replica.cc:333] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.379715 15375 raft_consensus.cc:2243] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.380209 15375 raft_consensus.cc:2272] T 10d633fea539421b8df68b6b69649892 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.381745 15375 tablet_replica.cc:333] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.382225 15375 raft_consensus.cc:2243] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.382556 15375 raft_consensus.cc:2272] T 12675d44700947d9871774efc58a8b70 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.385011 15375 tablet_replica.cc:333] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.385437 15375 raft_consensus.cc:2243] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.385941 15375 raft_consensus.cc:2272] T 326778f65c8845f5bc8e4a236d093bfe P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.387668 15375 tablet_replica.cc:333] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.388235 15375 raft_consensus.cc:2243] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.388751 15375 raft_consensus.cc:2272] T af129226cb2f41479ef5eb75771c860b P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.390368 15375 tablet_replica.cc:333] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.390799 15375 raft_consensus.cc:2243] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.391541 15375 raft_consensus.cc:2272] T 0d2622edd6954367a260d3600443dd26 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.393229 15375 tablet_replica.cc:333] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.393698 15375 raft_consensus.cc:2243] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.394147 15375 raft_consensus.cc:2272] T 3c7e1fed9cf44fa0b10d749e42e6d702 P f959652a42f34a81aca5da9faec0a7a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.395890 17219 consensus_peers.cc:597] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.396080 15375 tablet_replica.cc:333] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.396582 15375 raft_consensus.cc:2243] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.397262 15375 raft_consensus.cc:2272] T 4bff71b9804b47cc915e34b23012509e P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.398912 15375 tablet_replica.cc:333] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.399355 15375 raft_consensus.cc:2243] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.400022 15375 raft_consensus.cc:2272] T d8c54bb34a3c42489cc93960f1717406 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.401208 16572 consensus_peers.cc:597] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.401604 15375 tablet_replica.cc:333] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.402092 15375 raft_consensus.cc:2243] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.402717 15375 raft_consensus.cc:2272] T e039f673c9814556a561795c68ee2950 P f959652a42f34a81aca5da9faec0a7a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.404508 15375 tablet_replica.cc:333] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3: stopping tablet replica
I20260204 08:59:05.404990 15375 raft_consensus.cc:2243] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.405682 15375 raft_consensus.cc:2272] T 6a1d2d7d1f3440c48f319087b6e44ee0 P f959652a42f34a81aca5da9faec0a7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.436272 17219 consensus_peers.cc:597] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.444034 17219 consensus_peers.cc:597] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.447424 16647 consensus_peers.cc:597] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.461702 17218 consensus_peers.cc:597] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 35380a227e2c4fa4a063d4fd67c30b53 (127.15.3.193:39621): Couldn't send request to peer 35380a227e2c4fa4a063d4fd67c30b53. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.467464 17219 consensus_peers.cc:597] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.506433 16478 auto_rebalancer.cc:256] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111)
W20260204 08:59:05.516180 16478 auto_rebalancer.cc:726] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111)
W20260204 08:59:05.516487 16478 auto_rebalancer.cc:266] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.15.3.193:39621: connect: Connection refused (error 111)
W20260204 08:59:05.517285 17219 consensus_peers.cc:597] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:42667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.530304 15375 tablet_server.cc:195] TabletServer@127.15.3.194:0 shutdown complete.
W20260204 08:59:05.552723 16647 consensus_peers.cc:597] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:42667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.557085 16647 consensus_peers.cc:597] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:42667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.571791 16647 consensus_peers.cc:597] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:42667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.611042 16647 consensus_peers.cc:597] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:42667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.621603 15375 tablet_server.cc:178] TabletServer@127.15.3.195:0 shutting down...
W20260204 08:59:05.628645 17218 consensus_peers.cc:597] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.629707 17218 consensus_peers.cc:597] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.646634 16647 consensus_peers.cc:597] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:42667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.649464 16647 consensus_peers.cc:597] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:42667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.668483 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:59:05.669258 15375 tablet_replica.cc:333] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.669811 15375 raft_consensus.cc:2243] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.670539 15375 raft_consensus.cc:2272] T 0b534820859442b49b61eb04ce7e2363 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.672289 15375 tablet_replica.cc:333] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.672768 15375 raft_consensus.cc:2243] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.673417 15375 raft_consensus.cc:2272] T c4fba286cf394487ab1cf2b45d55835b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.674997 15375 tablet_replica.cc:333] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.675488 15375 raft_consensus.cc:2243] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.675855 15375 raft_consensus.cc:2272] T a2372d97d9af497ea9e6782d61032982 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.677343 15375 tablet_replica.cc:333] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.677826 15375 raft_consensus.cc:2243] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.678189 15375 raft_consensus.cc:2272] T 20fa246d3c414fa0b616da38a625bdfe P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.679728 15375 tablet_replica.cc:333] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.680184 15375 raft_consensus.cc:2243] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.680791 15375 raft_consensus.cc:2272] T 82c2a342cc8c4de99746b3951b711b0c P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.682174 15375 tablet_replica.cc:333] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.682608 15375 raft_consensus.cc:2243] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.683254 15375 raft_consensus.cc:2272] T 3326e90f03344694ace417ed6615d3fa P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.684693 15375 tablet_replica.cc:333] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.685159 15375 raft_consensus.cc:2243] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.685492 15375 raft_consensus.cc:2272] T f832ab776a0c43a4972fba456498de8c P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.686973 15375 tablet_replica.cc:333] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.687630 15375 raft_consensus.cc:2243] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.688153 15375 raft_consensus.cc:2272] T 68912efba25745d9ba6be48c71f92a38 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.690127 15375 tablet_replica.cc:333] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.690621 15375 raft_consensus.cc:2243] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.691228 15375 raft_consensus.cc:2272] T d7f0ef5121b748d18bbd7783a318fbc7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.693323 15375 tablet_replica.cc:333] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.693967 15375 raft_consensus.cc:2243] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.694780 15375 raft_consensus.cc:2272] T 376fb0bb77c04a0d9daf4939af20207f P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.696560 15375 tablet_replica.cc:333] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.697016 15375 raft_consensus.cc:2243] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.697321 15375 raft_consensus.cc:2272] T 92baf1e833884e0b9132f786b6d9791f P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.698681 15375 tablet_replica.cc:333] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.699132 15375 raft_consensus.cc:2243] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.699520 15375 raft_consensus.cc:2272] T a2e4ca7bedb84f7ba570333f98fb5de5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.700977 15375 tablet_replica.cc:333] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.701406 15375 raft_consensus.cc:2243] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.702013 15375 raft_consensus.cc:2272] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.703497 15375 tablet_replica.cc:333] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.704023 15375 raft_consensus.cc:2243] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.704660 15375 raft_consensus.cc:2272] T fc74f40262504431847cf4419a26b480 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.706521 15375 tablet_replica.cc:333] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.707060 15375 raft_consensus.cc:2243] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
W20260204 08:59:05.707355 16647 consensus_peers.cc:597] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 -> Peer f959652a42f34a81aca5da9faec0a7a3 (127.15.3.194:42667): Couldn't send request to peer f959652a42f34a81aca5da9faec0a7a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.194:42667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.707808 15375 raft_consensus.cc:2272] T 569b49ee7fc94d7bab7861620dbccfed P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.709419 15375 tablet_replica.cc:333] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.709882 15375 raft_consensus.cc:2243] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.710495 15375 raft_consensus.cc:2272] T 457a55a8c34648f6ae2a009fcb9fd749 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.712008 15375 tablet_replica.cc:333] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.712462 15375 raft_consensus.cc:2243] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.712814 15375 raft_consensus.cc:2272] T 3fd60f400d0147959fa060cf8359ae32 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.714267 15375 tablet_replica.cc:333] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.714718 15375 raft_consensus.cc:2243] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.715322 15375 raft_consensus.cc:2272] T 4dc53e7c74664efe82fc5edb6dfca943 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.716822 15375 tablet_replica.cc:333] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.717286 15375 raft_consensus.cc:2243] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.717887 15375 raft_consensus.cc:2272] T b4a8c1585bad41eb94f02214a751600b P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.719380 15375 tablet_replica.cc:333] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.719869 15375 raft_consensus.cc:2243] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.720461 15375 raft_consensus.cc:2272] T 3018fb4c08d3462f90e72e4df6d716c8 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.721896 15375 tablet_replica.cc:333] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.722337 15375 raft_consensus.cc:2243] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.722664 15375 raft_consensus.cc:2272] T 91a7c7c248c04840817bf3090ca01597 P 86e16045049f4f87a94336b5d2262328 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.724116 15375 tablet_replica.cc:333] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.724615 15375 raft_consensus.cc:2243] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.724965 15375 raft_consensus.cc:2272] T 56a1c6e078b242738f19a73c490d3830 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.726509 15375 tablet_replica.cc:333] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.726960 15375 raft_consensus.cc:2243] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.727365 15375 raft_consensus.cc:2272] T aa4d147d1fb14e6ca905000e39085dfa P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.729115 15375 tablet_replica.cc:333] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.729530 15375 raft_consensus.cc:2243] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.729846 15375 raft_consensus.cc:2272] T a2c39bf3d0c849a1aa4ef353e0e67991 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.731388 15375 tablet_replica.cc:333] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.731895 15375 raft_consensus.cc:2243] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.732234 15375 raft_consensus.cc:2272] T 0081bf9327d5467897615fd29a2a5ad6 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.733749 15375 tablet_replica.cc:333] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.734298 15375 raft_consensus.cc:2243] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.734674 15375 raft_consensus.cc:2272] T 232077fdd4b44876ba13c53b7f42f888 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.736618 15375 tablet_replica.cc:333] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
W20260204 08:59:05.737115 17218 consensus_peers.cc:597] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.737304 15375 raft_consensus.cc:2243] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.738090 15375 raft_consensus.cc:2272] T deb06db695bc4cd7bcef0b6d5f27c3e3 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:05.738962 17218 consensus_peers.cc:597] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.739953 15375 tablet_replica.cc:333] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.740454 15375 raft_consensus.cc:2243] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.740883 15375 raft_consensus.cc:2272] T 4d0dd5730ea04490876711f04afa95e5 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.742900 15375 tablet_replica.cc:333] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.743315 15375 raft_consensus.cc:2243] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.743635 15375 raft_consensus.cc:2272] T e039f673c9814556a561795c68ee2950 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.745184 15375 tablet_replica.cc:333] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.745612 15375 raft_consensus.cc:2243] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.745944 15375 raft_consensus.cc:2272] T 12675d44700947d9871774efc58a8b70 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.747421 15375 tablet_replica.cc:333] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.747900 15375 raft_consensus.cc:2243] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.748538 15375 raft_consensus.cc:2272] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.749940 15375 tablet_replica.cc:333] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.750384 15375 raft_consensus.cc:2243] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.750694 15375 raft_consensus.cc:2272] T 29067ae5902a405283277bb95a626f04 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.752188 15375 tablet_replica.cc:333] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.752580 15375 raft_consensus.cc:2243] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.753160 15375 raft_consensus.cc:2272] T 10d633fea539421b8df68b6b69649892 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.754612 15375 tablet_replica.cc:333] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.755021 15375 raft_consensus.cc:2243] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.755337 15375 raft_consensus.cc:2272] T 6e3200a486ed4e50b8cd3fbace254888 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.756920 15375 tablet_replica.cc:333] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.757453 15375 raft_consensus.cc:2243] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.758239 15375 raft_consensus.cc:2272] T e6a3887aa0f64b1a8d49dc7e0e061459 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.760162 15375 tablet_replica.cc:333] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.760591 15375 raft_consensus.cc:2243] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.761035 15375 raft_consensus.cc:2272] T be0afba4e5c14c95870971bc8c2c7225 P 86e16045049f4f87a94336b5d2262328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.762444 15375 tablet_replica.cc:333] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.762862 15375 raft_consensus.cc:2243] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.763183 15375 raft_consensus.cc:2272] T 0f175f5811e74a91b26e6ac39bc9d0b7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.764601 15375 tablet_replica.cc:333] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.765021 15375 raft_consensus.cc:2243] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.765316 15375 raft_consensus.cc:2272] T 063bb12920e44068a818b00a8573328e P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.766710 15375 tablet_replica.cc:333] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.767127 15375 raft_consensus.cc:2243] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.767580 15375 raft_consensus.cc:2272] T 4773c29a00ab47f9b55fd479ace200e7 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.769197 15375 tablet_replica.cc:333] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.769604 15375 raft_consensus.cc:2243] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.769923 15375 raft_consensus.cc:2272] T af129226cb2f41479ef5eb75771c860b P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.771359 15375 tablet_replica.cc:333] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.771801 15375 raft_consensus.cc:2243] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.772109 15375 raft_consensus.cc:2272] T 0d2622edd6954367a260d3600443dd26 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.773581 15375 tablet_replica.cc:333] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.774016 15375 raft_consensus.cc:2243] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.774391 15375 raft_consensus.cc:2272] T 3c7e1fed9cf44fa0b10d749e42e6d702 P 86e16045049f4f87a94336b5d2262328 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.775877 15375 tablet_replica.cc:333] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.776264 15375 raft_consensus.cc:2243] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.776616 15375 raft_consensus.cc:2272] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.778111 15375 tablet_replica.cc:333] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.778501 15375 raft_consensus.cc:2243] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.778805 15375 raft_consensus.cc:2272] T 795715e8aaa1450e811ecebf022fd69b P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.780333 15375 tablet_replica.cc:333] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328: stopping tablet replica
I20260204 08:59:05.780696 15375 raft_consensus.cc:2243] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.781002 15375 raft_consensus.cc:2272] T d8c54bb34a3c42489cc93960f1717406 P 86e16045049f4f87a94336b5d2262328 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.849995 15375 tablet_server.cc:195] TabletServer@127.15.3.195:0 shutdown complete.
W20260204 08:59:05.925685 17218 consensus_peers.cc:597] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.195:39491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.927930 17218 consensus_peers.cc:597] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.195:39491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:05.930048 17218 consensus_peers.cc:597] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.195:39491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:05.936389 15375 tablet_server.cc:178] TabletServer@127.15.3.196:0 shutting down...
I20260204 08:59:05.960850 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:59:05.961529 15375 tablet_replica.cc:333] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.962314 15375 raft_consensus.cc:2243] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.962954 15375 raft_consensus.cc:2272] T be0afba4e5c14c95870971bc8c2c7225 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.964548 15375 tablet_replica.cc:333] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.965052 15375 raft_consensus.cc:2243] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.965462 15375 raft_consensus.cc:2272] T 82c2a342cc8c4de99746b3951b711b0c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.966908 15375 tablet_replica.cc:333] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.967375 15375 raft_consensus.cc:2243] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.967821 15375 raft_consensus.cc:2272] T c4fba286cf394487ab1cf2b45d55835b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.969285 15375 tablet_replica.cc:333] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.969732 15375 raft_consensus.cc:2243] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.970360 15375 raft_consensus.cc:2272] T 92baf1e833884e0b9132f786b6d9791f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.971817 15375 tablet_replica.cc:333] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.972278 15375 raft_consensus.cc:2243] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.972692 15375 raft_consensus.cc:2272] T 4773c29a00ab47f9b55fd479ace200e7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.974228 15375 tablet_replica.cc:333] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.974745 15375 raft_consensus.cc:2243] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.975178 15375 raft_consensus.cc:2272] T 4dc53e7c74664efe82fc5edb6dfca943 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.976593 15375 tablet_replica.cc:333] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.977072 15375 raft_consensus.cc:2243] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.977474 15375 raft_consensus.cc:2272] T 796b324679b4492db7f68598b0a2d4e2 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.978929 15375 tablet_replica.cc:333] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.979461 15375 raft_consensus.cc:2243] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.979918 15375 raft_consensus.cc:2272] T b4a8c1585bad41eb94f02214a751600b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.981343 15375 tablet_replica.cc:333] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.981786 15375 raft_consensus.cc:2243] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.982208 15375 raft_consensus.cc:2272] T 4d0dd5730ea04490876711f04afa95e5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.983804 15375 tablet_replica.cc:333] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.984279 15375 raft_consensus.cc:2243] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.984680 15375 raft_consensus.cc:2272] T c77c8d18f5274899a308f09e7aa99de3 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.986235 15375 tablet_replica.cc:333] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.986711 15375 raft_consensus.cc:2243] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:05.987323 15375 raft_consensus.cc:2272] T 68912efba25745d9ba6be48c71f92a38 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.988956 15375 tablet_replica.cc:333] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.989447 15375 raft_consensus.cc:2243] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.989776 15375 raft_consensus.cc:2272] T d8c54bb34a3c42489cc93960f1717406 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.991232 15375 tablet_replica.cc:333] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.991739 15375 raft_consensus.cc:2243] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.992173 15375 raft_consensus.cc:2272] T 795715e8aaa1450e811ecebf022fd69b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.993659 15375 tablet_replica.cc:333] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.994135 15375 raft_consensus.cc:2243] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.994563 15375 raft_consensus.cc:2272] T e6a3887aa0f64b1a8d49dc7e0e061459 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.996380 15375 tablet_replica.cc:333] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:05.996928 15375 raft_consensus.cc:2243] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:05.997541 15375 raft_consensus.cc:2272] T 72c4736a5d244206a366cb1166df369e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:05.999621 15375 tablet_replica.cc:333] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.000094 15375 raft_consensus.cc:2243] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.000708 15375 raft_consensus.cc:2272] T 801ee654117f4d37b4ad0c66b46fd4e4 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.002326 15375 tablet_replica.cc:333] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.002786 15375 raft_consensus.cc:2243] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.003397 15375 raft_consensus.cc:2272] T b4a8f14fd5174a4d98b1849c67325173 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.004858 15375 tablet_replica.cc:333] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.005328 15375 raft_consensus.cc:2243] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.005754 15375 raft_consensus.cc:2272] T 06e4fe1636ad4bb8bbdbeb6009a8d41d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.007190 15375 tablet_replica.cc:333] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.007679 15375 raft_consensus.cc:2243] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.008093 15375 raft_consensus.cc:2272] T 3326e90f03344694ace417ed6615d3fa P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.009615 15375 tablet_replica.cc:333] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.010078 15375 raft_consensus.cc:2243] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.010704 15375 raft_consensus.cc:2272] T 810a9a6b2d154b6d9a7b8c4d2db5f692 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.012305 15375 tablet_replica.cc:333] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.012784 15375 raft_consensus.cc:2243] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.013208 15375 raft_consensus.cc:2272] T 4bff71b9804b47cc915e34b23012509e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.015282 15375 tablet_replica.cc:333] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.015767 15375 raft_consensus.cc:2243] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.016531 15375 raft_consensus.cc:2272] T 3fd60f400d0147959fa060cf8359ae32 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.017983 15375 tablet_replica.cc:333] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.018417 15375 raft_consensus.cc:2243] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.019111 15375 raft_consensus.cc:2272] T 6e3200a486ed4e50b8cd3fbace254888 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.020568 15375 tablet_replica.cc:333] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.021013 15375 raft_consensus.cc:2243] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.021420 15375 raft_consensus.cc:2272] T 10d633fea539421b8df68b6b69649892 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.023345 15375 tablet_replica.cc:333] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.023909 15375 raft_consensus.cc:2243] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.024499 15375 raft_consensus.cc:2272] T d51b94b814b049a19e2c94de66731467 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.026249 15375 tablet_replica.cc:333] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.026763 15375 raft_consensus.cc:2243] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.027335 15375 raft_consensus.cc:2272] T aac4f009108d4057aee3fb4274b6d320 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.028744 15375 tablet_replica.cc:333] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.029186 15375 raft_consensus.cc:2243] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.029521 15375 raft_consensus.cc:2272] T 35fde83161df49e09eb28ee05a4ad35f P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.030995 15375 tablet_replica.cc:333] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.031412 15375 raft_consensus.cc:2243] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.031754 15375 raft_consensus.cc:2272] T 3018fb4c08d3462f90e72e4df6d716c8 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.033320 15375 tablet_replica.cc:333] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.033807 15375 raft_consensus.cc:2243] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.034265 15375 raft_consensus.cc:2272] T fc74f40262504431847cf4419a26b480 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.035723 15375 tablet_replica.cc:333] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.036257 15375 raft_consensus.cc:2243] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.036741 15375 raft_consensus.cc:2272] T a2e4ca7bedb84f7ba570333f98fb5de5 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.038595 15375 tablet_replica.cc:333] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.039206 15375 raft_consensus.cc:2243] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.039820 15375 raft_consensus.cc:2272] T 9c2c27e6ec9949a0ae96e967adf3ffd9 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:06.039816 17218 consensus_peers.cc:597] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 -> Peer 86e16045049f4f87a94336b5d2262328 (127.15.3.195:39491): Couldn't send request to peer 86e16045049f4f87a94336b5d2262328. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.195:39491: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:06.041460 15375 tablet_replica.cc:333] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.041944 15375 raft_consensus.cc:2243] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.042380 15375 raft_consensus.cc:2272] T 8689b3435b4f43a1b5a8c5af26f23c2c P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.043900 15375 tablet_replica.cc:333] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.044342 15375 raft_consensus.cc:2243] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.044736 15375 raft_consensus.cc:2272] T 457a55a8c34648f6ae2a009fcb9fd749 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.046270 15375 tablet_replica.cc:333] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.046721 15375 raft_consensus.cc:2243] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.047150 15375 raft_consensus.cc:2272] T 6a1d2d7d1f3440c48f319087b6e44ee0 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.048710 15375 tablet_replica.cc:333] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.049167 15375 raft_consensus.cc:2243] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.049826 15375 raft_consensus.cc:2272] T 12675d44700947d9871774efc58a8b70 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.051391 15375 tablet_replica.cc:333] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.051927 15375 raft_consensus.cc:2243] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.052557 15375 raft_consensus.cc:2272] T 61ec06ad82864d3a91228c325fd1af2d P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.054056 15375 tablet_replica.cc:333] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.054507 15375 raft_consensus.cc:2243] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.055116 15375 raft_consensus.cc:2272] T 20fa246d3c414fa0b616da38a625bdfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.056666 15375 tablet_replica.cc:333] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.057108 15375 raft_consensus.cc:2243] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.057703 15375 raft_consensus.cc:2272] T d7f0ef5121b748d18bbd7783a318fbc7 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.059190 15375 tablet_replica.cc:333] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.059624 15375 raft_consensus.cc:2243] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.060243 15375 raft_consensus.cc:2272] T 063bb12920e44068a818b00a8573328e P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.061734 15375 tablet_replica.cc:333] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.062198 15375 raft_consensus.cc:2243] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.062630 15375 raft_consensus.cc:2272] T 326778f65c8845f5bc8e4a236d093bfe P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.064132 15375 tablet_replica.cc:333] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.064570 15375 raft_consensus.cc:2243] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.065181 15375 raft_consensus.cc:2272] T af129226cb2f41479ef5eb75771c860b P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.066645 15375 tablet_replica.cc:333] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.067061 15375 raft_consensus.cc:2243] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.067421 15375 raft_consensus.cc:2272] T 147ea8d1b63e4e9e8f084676f3f0ea12 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.068917 15375 tablet_replica.cc:333] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842: stopping tablet replica
I20260204 08:59:06.069329 15375 raft_consensus.cc:2243] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:06.069686 15375 raft_consensus.cc:2272] T 0b534820859442b49b61eb04ce7e2363 P 6e58e6edfb3b43b1b5378f9e9a26e842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.122493 15375 tablet_server.cc:195] TabletServer@127.15.3.196:0 shutdown complete.
I20260204 08:59:06.173192 15375 master.cc:561] Master@127.15.3.254:45355 shutting down...
I20260204 08:59:06.196648 15375 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:06.197151 15375 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:06.197435 15375 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3b7553c320c44328a698b00435cfe869: stopping tablet replica
I20260204 08:59:06.217024 15375 master.cc:583] Master@127.15.3.254:45355 shutdown complete.
[ OK ] LeaderRebalancerTest.AddTserver (48258 ms)
[ RUN ] LeaderRebalancerTest.RestartTserver
I20260204 08:59:06.298041 15375 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.3.254:37341
I20260204 08:59:06.299121 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:59:06.304042 18175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.304077 18176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.305367 18178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:59:06.306995 15375 server_base.cc:1060] running on GCE node
I20260204 08:59:06.308151 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:59:06.308331 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:59:06.308442 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195546308431 us; error 0 us; skew 500 ppm
I20260204 08:59:06.308876 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:59:06.311033 15375 webserver.cc:492] Webserver started at http://127.15.3.254:35151/ using document root <none> and password file <none>
I20260204 08:59:06.311444 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:59:06.311599 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:59:06.311858 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:59:06.312826 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/master-0-root/instance:
uuid: "0e2ca9d5b67049599afaed529bf98097"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.317401 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260204 08:59:06.320485 18183 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.321166 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260204 08:59:06.321441 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/master-0-root
uuid: "0e2ca9d5b67049599afaed529bf98097"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.321707 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:59:06.364100 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:59:06.365264 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:59:06.401189 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.254:37341
I20260204 08:59:06.401304 18234 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.254:37341 every 8 connection(s)
I20260204 08:59:06.404788 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:06.414595 18235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: Bootstrap starting.
I20260204 08:59:06.418958 18235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:06.422950 18235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: No bootstrap required, opened a new log
I20260204 08:59:06.424904 18235 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2ca9d5b67049599afaed529bf98097" member_type: VOTER }
I20260204 08:59:06.425247 18235 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:06.425427 18235 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e2ca9d5b67049599afaed529bf98097, State: Initialized, Role: FOLLOWER
I20260204 08:59:06.425868 18235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2ca9d5b67049599afaed529bf98097" member_type: VOTER }
I20260204 08:59:06.426254 18235 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 08:59:06.426435 18235 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 08:59:06.426630 18235 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:06.431010 18235 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2ca9d5b67049599afaed529bf98097" member_type: VOTER }
I20260204 08:59:06.431440 18235 leader_election.cc:304] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e2ca9d5b67049599afaed529bf98097; no voters:
I20260204 08:59:06.432463 18235 leader_election.cc:290] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 08:59:06.432765 18238 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:06.434018 18238 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [term 1 LEADER]: Becoming Leader. State: Replica: 0e2ca9d5b67049599afaed529bf98097, State: Running, Role: LEADER
I20260204 08:59:06.434538 18238 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2ca9d5b67049599afaed529bf98097" member_type: VOTER }
I20260204 08:59:06.435148 18235 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [sys.catalog]: configured and running, proceeding with master startup.
I20260204 08:59:06.438634 18239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e2ca9d5b67049599afaed529bf98097" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2ca9d5b67049599afaed529bf98097" member_type: VOTER } }
I20260204 08:59:06.439210 18239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [sys.catalog]: This master's current role is: LEADER
I20260204 08:59:06.440352 18240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e2ca9d5b67049599afaed529bf98097. Latest consensus state: current_term: 1 leader_uuid: "0e2ca9d5b67049599afaed529bf98097" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2ca9d5b67049599afaed529bf98097" member_type: VOTER } }
I20260204 08:59:06.440964 18240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097 [sys.catalog]: This master's current role is: LEADER
I20260204 08:59:06.445432 18246 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 08:59:06.450922 18246 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 08:59:06.451834 15375 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 08:59:06.458670 18246 catalog_manager.cc:1357] Generated new cluster ID: ad6c5e89425d4b8caee31377ed780bc5
I20260204 08:59:06.458962 18246 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 08:59:06.484692 18246 catalog_manager.cc:1380] Generated new certificate authority record
I20260204 08:59:06.486024 18246 catalog_manager.cc:1514] Loading token signing keys...
I20260204 08:59:06.500218 18246 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: Generated new TSK 0
I20260204 08:59:06.500794 18246 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 08:59:06.517957 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:59:06.523535 18256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.524505 18257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.525564 18259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:59:06.525899 15375 server_base.cc:1060] running on GCE node
I20260204 08:59:06.526865 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:59:06.527050 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:59:06.527170 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195546527159 us; error 0 us; skew 500 ppm
I20260204 08:59:06.527604 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:59:06.529624 15375 webserver.cc:492] Webserver started at http://127.15.3.193:32833/ using document root <none> and password file <none>
I20260204 08:59:06.530046 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:59:06.530197 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:59:06.530419 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:59:06.531574 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/instance:
uuid: "354a648f08a44b98a7f93d74b0ea93ab"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.535597 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s
I20260204 08:59:06.538820 18264 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.539490 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260204 08:59:06.539790 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
uuid: "354a648f08a44b98a7f93d74b0ea93ab"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.540045 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:59:06.552695 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:59:06.553761 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:59:06.555135 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:59:06.557214 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:59:06.557387 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.557623 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:59:06.557766 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.594277 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.193:33867
I20260204 08:59:06.594383 18326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.193:33867 every 8 connection(s)
I20260204 08:59:06.598809 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:59:06.606007 18332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.606653 18331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:59:06.609311 15375 server_base.cc:1060] running on GCE node
W20260204 08:59:06.609447 18334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:59:06.611047 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:59:06.611299 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:59:06.611466 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195546611449 us; error 0 us; skew 500 ppm
I20260204 08:59:06.611568 18327 heartbeater.cc:344] Connected to a master server at 127.15.3.254:37341
I20260204 08:59:06.611972 18327 heartbeater.cc:461] Registering TS with master...
I20260204 08:59:06.612213 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:59:06.612777 18327 heartbeater.cc:507] Master 127.15.3.254:37341 requested a full tablet report, sending...
I20260204 08:59:06.614600 15375 webserver.cc:492] Webserver started at http://127.15.3.194:44737/ using document root <none> and password file <none>
I20260204 08:59:06.614918 18200 ts_manager.cc:194] Registered new tserver with Master: 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:06.615229 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:59:06.615492 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:59:06.615829 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:59:06.617249 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/instance:
uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.617249 18200 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47984
I20260204 08:59:06.622069 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260204 08:59:06.625104 18339 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.625775 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260204 08:59:06.626021 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-1-root
uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.626255 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:59:06.637920 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:59:06.638916 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:59:06.640216 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:59:06.642230 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:59:06.642447 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.642660 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:59:06.642805 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.678959 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.194:43883
I20260204 08:59:06.679049 18401 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.194:43883 every 8 connection(s)
I20260204 08:59:06.683279 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:59:06.688866 18405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.690183 18406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.692621 18408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:59:06.693044 18402 heartbeater.cc:344] Connected to a master server at 127.15.3.254:37341
I20260204 08:59:06.693396 15375 server_base.cc:1060] running on GCE node
I20260204 08:59:06.693442 18402 heartbeater.cc:461] Registering TS with master...
I20260204 08:59:06.694352 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260204 08:59:06.694360 18402 heartbeater.cc:507] Master 127.15.3.254:37341 requested a full tablet report, sending...
W20260204 08:59:06.694619 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:59:06.694813 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195546694797 us; error 0 us; skew 500 ppm
I20260204 08:59:06.695348 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:59:06.696403 18200 ts_manager.cc:194] Registered new tserver with Master: 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:06.697777 15375 webserver.cc:492] Webserver started at http://127.15.3.195:45489/ using document root <none> and password file <none>
I20260204 08:59:06.698145 18200 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47988
I20260204 08:59:06.698385 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:59:06.698657 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:59:06.698972 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:59:06.700052 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/instance:
uuid: "c61e83e5fb7445e8bce7eca695977903"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.703981 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260204 08:59:06.706862 18413 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.707552 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260204 08:59:06.707841 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-2-root
uuid: "c61e83e5fb7445e8bce7eca695977903"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.708093 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:59:06.741084 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:59:06.742275 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:59:06.743618 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:59:06.745769 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:59:06.745940 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.746158 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:59:06.746294 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.782754 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.195:40161
I20260204 08:59:06.782838 18475 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.195:40161 every 8 connection(s)
I20260204 08:59:06.787115 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:59:06.792649 18479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.793704 18480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:06.794931 18482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:59:06.796175 15375 server_base.cc:1060] running on GCE node
I20260204 08:59:06.797008 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:59:06.797241 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:59:06.797420 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195546797400 us; error 0 us; skew 500 ppm
I20260204 08:59:06.798007 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:59:06.798295 18476 heartbeater.cc:344] Connected to a master server at 127.15.3.254:37341
I20260204 08:59:06.798664 18476 heartbeater.cc:461] Registering TS with master...
I20260204 08:59:06.799494 18476 heartbeater.cc:507] Master 127.15.3.254:37341 requested a full tablet report, sending...
I20260204 08:59:06.800563 15375 webserver.cc:492] Webserver started at http://127.15.3.196:37687/ using document root <none> and password file <none>
I20260204 08:59:06.801172 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:59:06.801338 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 08:59:06.801564 15375 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 08:59:06.801512 18200 ts_manager.cc:194] Registered new tserver with Master: c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:06.802716 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-3-root/instance:
uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.802853 18200 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48000
I20260204 08:59:06.806910 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260204 08:59:06.810070 18487 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.810739 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260204 08:59:06.810992 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-3-root
uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:06.811282 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:59:06.831981 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:59:06.833104 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:59:06.834249 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 08:59:06.836272 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 08:59:06.836460 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.836665 15375 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 08:59:06.836817 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:06.873906 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.196:33765
I20260204 08:59:06.873989 18549 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.196:33765 every 8 connection(s)
I20260204 08:59:06.885890 18550 heartbeater.cc:344] Connected to a master server at 127.15.3.254:37341
I20260204 08:59:06.886200 18550 heartbeater.cc:461] Registering TS with master...
I20260204 08:59:06.886842 18550 heartbeater.cc:507] Master 127.15.3.254:37341 requested a full tablet report, sending...
I20260204 08:59:06.888470 18200 ts_manager.cc:194] Registered new tserver with Master: 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:06.889137 15375 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01239405s
I20260204 08:59:06.889994 18200 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48004
I20260204 08:59:06.912259 18200 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48008:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260204 08:59:07.139544 18441 tablet_service.cc:1505] Processing CreateTablet for tablet 481bf2deabd7443ca092663a359e8f3e (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260204 08:59:07.141037 18441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481bf2deabd7443ca092663a359e8f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.144323 18439 tablet_service.cc:1505] Processing CreateTablet for tablet 6da43fe9c941486e99fb39317a812801 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260204 08:59:07.145743 18439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da43fe9c941486e99fb39317a812801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.145977 18440 tablet_service.cc:1505] Processing CreateTablet for tablet a43a955d03304c0b847a09e4d430afc1 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260204 08:59:07.146713 18367 tablet_service.cc:1505] Processing CreateTablet for tablet a43a955d03304c0b847a09e4d430afc1 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260204 08:59:07.147290 18440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43a955d03304c0b847a09e4d430afc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.148005 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43a955d03304c0b847a09e4d430afc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.150802 18366 tablet_service.cc:1505] Processing CreateTablet for tablet cf58feb0b26e413a84bdd849dedcaa81 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260204 08:59:07.152102 18366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf58feb0b26e413a84bdd849dedcaa81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.156672 18365 tablet_service.cc:1505] Processing CreateTablet for tablet 6da43fe9c941486e99fb39317a812801 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260204 08:59:07.158061 18365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da43fe9c941486e99fb39317a812801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.160653 18364 tablet_service.cc:1505] Processing CreateTablet for tablet 10a6d690ab964c9892bfdda747cf6fc0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260204 08:59:07.161947 18364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a6d690ab964c9892bfdda747cf6fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.164707 18292 tablet_service.cc:1505] Processing CreateTablet for tablet 481bf2deabd7443ca092663a359e8f3e (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260204 08:59:07.166055 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481bf2deabd7443ca092663a359e8f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.167353 18436 tablet_service.cc:1505] Processing CreateTablet for tablet 4cf3dc838d4343bab90e123d525dfc82 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260204 08:59:07.168711 18436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf3dc838d4343bab90e123d525dfc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.168744 18291 tablet_service.cc:1505] Processing CreateTablet for tablet a43a955d03304c0b847a09e4d430afc1 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260204 08:59:07.170089 18291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43a955d03304c0b847a09e4d430afc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.164707 18438 tablet_service.cc:1505] Processing CreateTablet for tablet 10a6d690ab964c9892bfdda747cf6fc0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260204 08:59:07.172983 18438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a6d690ab964c9892bfdda747cf6fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.173080 18289 tablet_service.cc:1505] Processing CreateTablet for tablet 10a6d690ab964c9892bfdda747cf6fc0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260204 08:59:07.171712 18435 tablet_service.cc:1505] Processing CreateTablet for tablet 4e191332a2aa4570928931434e061abb (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260204 08:59:07.174326 18289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a6d690ab964c9892bfdda747cf6fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.174988 18435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e191332a2aa4570928931434e061abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.165710 18437 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6b7e58d6c748838ef0cdff0f018574 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260204 08:59:07.176553 18437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6b7e58d6c748838ef0cdff0f018574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.176282 18288 tablet_service.cc:1505] Processing CreateTablet for tablet b0195e35f81741c9858f099628293034 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260204 08:59:07.177521 18288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0195e35f81741c9858f099628293034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.178970 18290 tablet_service.cc:1505] Processing CreateTablet for tablet cf58feb0b26e413a84bdd849dedcaa81 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260204 08:59:07.179584 18363 tablet_service.cc:1505] Processing CreateTablet for tablet b0195e35f81741c9858f099628293034 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260204 08:59:07.180294 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf58feb0b26e413a84bdd849dedcaa81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.180896 18363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0195e35f81741c9858f099628293034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.182786 18362 tablet_service.cc:1505] Processing CreateTablet for tablet 4cf3dc838d4343bab90e123d525dfc82 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260204 08:59:07.184813 18361 tablet_service.cc:1505] Processing CreateTablet for tablet 4e191332a2aa4570928931434e061abb (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260204 08:59:07.186034 18362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf3dc838d4343bab90e123d525dfc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.190569 18434 tablet_service.cc:1505] Processing CreateTablet for tablet 93c6901415594017879443427a92d4c9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260204 08:59:07.191856 18434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c6901415594017879443427a92d4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.192286 18361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e191332a2aa4570928931434e061abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.194658 18287 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6b7e58d6c748838ef0cdff0f018574 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260204 08:59:07.195963 18287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6b7e58d6c748838ef0cdff0f018574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.196888 18360 tablet_service.cc:1505] Processing CreateTablet for tablet 4b1121fcea2a42bf88a9d98faffffd18 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260204 08:59:07.198123 18360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1121fcea2a42bf88a9d98faffffd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.200755 18433 tablet_service.cc:1505] Processing CreateTablet for tablet 5a6bc13bd9a04185a8b1ad985fb86531 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260204 08:59:07.201388 18359 tablet_service.cc:1505] Processing CreateTablet for tablet 5a6bc13bd9a04185a8b1ad985fb86531 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260204 08:59:07.202049 18433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6bc13bd9a04185a8b1ad985fb86531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.202622 18359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6bc13bd9a04185a8b1ad985fb86531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.204775 18432 tablet_service.cc:1505] Processing CreateTablet for tablet ba427f707a5a42fb975b3a3ee7215aa6 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260204 08:59:07.205163 18286 tablet_service.cc:1505] Processing CreateTablet for tablet 4e191332a2aa4570928931434e061abb (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260204 08:59:07.206037 18432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba427f707a5a42fb975b3a3ee7215aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.206460 18286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e191332a2aa4570928931434e061abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.208770 18358 tablet_service.cc:1505] Processing CreateTablet for tablet ba427f707a5a42fb975b3a3ee7215aa6 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260204 08:59:07.209424 18285 tablet_service.cc:1505] Processing CreateTablet for tablet 4b1121fcea2a42bf88a9d98faffffd18 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260204 08:59:07.210031 18358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba427f707a5a42fb975b3a3ee7215aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.210701 18285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1121fcea2a42bf88a9d98faffffd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.213203 18284 tablet_service.cc:1505] Processing CreateTablet for tablet 93c6901415594017879443427a92d4c9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260204 08:59:07.216320 18283 tablet_service.cc:1505] Processing CreateTablet for tablet ba427f707a5a42fb975b3a3ee7215aa6 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260204 08:59:07.221741 18284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c6901415594017879443427a92d4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.225258 18283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba427f707a5a42fb975b3a3ee7215aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.237329 18515 tablet_service.cc:1505] Processing CreateTablet for tablet 481bf2deabd7443ca092663a359e8f3e (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260204 08:59:07.238669 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481bf2deabd7443ca092663a359e8f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.241161 18514 tablet_service.cc:1505] Processing CreateTablet for tablet cf58feb0b26e413a84bdd849dedcaa81 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260204 08:59:07.242449 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf58feb0b26e413a84bdd849dedcaa81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.261106 18513 tablet_service.cc:1505] Processing CreateTablet for tablet 6da43fe9c941486e99fb39317a812801 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260204 08:59:07.262524 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da43fe9c941486e99fb39317a812801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.265033 18512 tablet_service.cc:1505] Processing CreateTablet for tablet b0195e35f81741c9858f099628293034 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260204 08:59:07.267524 18511 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6b7e58d6c748838ef0cdff0f018574 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260204 08:59:07.272004 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0195e35f81741c9858f099628293034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.273507 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6b7e58d6c748838ef0cdff0f018574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.280683 18510 tablet_service.cc:1505] Processing CreateTablet for tablet 4cf3dc838d4343bab90e123d525dfc82 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260204 08:59:07.282011 18510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf3dc838d4343bab90e123d525dfc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.284971 18432 tablet_service.cc:1505] Processing CreateTablet for tablet 5d8340499d764f8cb6e95f63db6fb29f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260204 08:59:07.286221 18432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8340499d764f8cb6e95f63db6fb29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.288645 18509 tablet_service.cc:1505] Processing CreateTablet for tablet 4b1121fcea2a42bf88a9d98faffffd18 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260204 08:59:07.289867 18509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1121fcea2a42bf88a9d98faffffd18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.281210 18359 tablet_service.cc:1505] Processing CreateTablet for tablet c1f32c58bc4e422889e2b2739a3ca210 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260204 08:59:07.288199 18434 tablet_service.cc:1505] Processing CreateTablet for tablet 447dfe3ea93642ff9abd0f55be77ea9b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260204 08:59:07.292672 18434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447dfe3ea93642ff9abd0f55be77ea9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.296630 18359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f32c58bc4e422889e2b2739a3ca210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.317452 18508 tablet_service.cc:1505] Processing CreateTablet for tablet 93c6901415594017879443427a92d4c9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260204 08:59:07.318781 18508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c6901415594017879443427a92d4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.352451 18283 tablet_service.cc:1505] Processing CreateTablet for tablet c1f32c58bc4e422889e2b2739a3ca210 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260204 08:59:07.353757 18283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f32c58bc4e422889e2b2739a3ca210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.355207 18439 tablet_service.cc:1505] Processing CreateTablet for tablet 6997ab65a1f44cd18707ec9e0afa05e9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260204 08:59:07.356525 18439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6997ab65a1f44cd18707ec9e0afa05e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.362613 18292 tablet_service.cc:1505] Processing CreateTablet for tablet 447dfe3ea93642ff9abd0f55be77ea9b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260204 08:59:07.363974 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447dfe3ea93642ff9abd0f55be77ea9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.364444 18433 tablet_service.cc:1505] Processing CreateTablet for tablet ef72e5825eec43c3a4efa431934ec0e1 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260204 08:59:07.365849 18433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef72e5825eec43c3a4efa431934ec0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.373468 18507 tablet_service.cc:1505] Processing CreateTablet for tablet 5a6bc13bd9a04185a8b1ad985fb86531 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260204 08:59:07.374854 18507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6bc13bd9a04185a8b1ad985fb86531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.385272 18506 tablet_service.cc:1505] Processing CreateTablet for tablet c1f32c58bc4e422889e2b2739a3ca210 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260204 08:59:07.386686 18506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f32c58bc4e422889e2b2739a3ca210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.387617 18286 tablet_service.cc:1505] Processing CreateTablet for tablet 6997ab65a1f44cd18707ec9e0afa05e9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260204 08:59:07.388909 18286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6997ab65a1f44cd18707ec9e0afa05e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.396503 18288 tablet_service.cc:1505] Processing CreateTablet for tablet 5a4f4307728d44029b19b3b03f406068 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260204 08:59:07.397733 18288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4f4307728d44029b19b3b03f406068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.418635 18439 tablet_service.cc:1505] Processing CreateTablet for tablet 79332110ca7d46dd8fb7875471d3242d (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260204 08:59:07.420120 18439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79332110ca7d46dd8fb7875471d3242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.433715 18568 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:07.433801 18433 tablet_service.cc:1505] Processing CreateTablet for tablet f9d6ad3406784527a0e5f590724f204e (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260204 08:59:07.450129 18285 tablet_service.cc:1505] Processing CreateTablet for tablet 5ccfea57ae48454abf38341aee79315f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260204 08:59:07.450748 18248 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:59:07.451571 18285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccfea57ae48454abf38341aee79315f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.454957 18440 tablet_service.cc:1505] Processing CreateTablet for tablet 5a8edc898e45413484df91b064f36114 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260204 08:59:07.456513 18568 tablet_bootstrap.cc:654] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:07.456666 18358 tablet_service.cc:1505] Processing CreateTablet for tablet 5d8340499d764f8cb6e95f63db6fb29f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260204 08:59:07.457876 18358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8340499d764f8cb6e95f63db6fb29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.469640 18569 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:07.441531 18290 tablet_service.cc:1505] Processing CreateTablet for tablet ef72e5825eec43c3a4efa431934ec0e1 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260204 08:59:07.473431 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef72e5825eec43c3a4efa431934ec0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.474326 18291 tablet_service.cc:1505] Processing CreateTablet for tablet e09db0ac6e104e1e9a0ca7ebafab0cde (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260204 08:59:07.475570 18291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09db0ac6e104e1e9a0ca7ebafab0cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.478161 18567 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:07.472242 18287 tablet_service.cc:1505] Processing CreateTablet for tablet f9d6ad3406784527a0e5f590724f204e (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260204 08:59:07.492765 18287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d6ad3406784527a0e5f590724f204e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.479729 18433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d6ad3406784527a0e5f590724f204e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.483443 18289 tablet_service.cc:1505] Processing CreateTablet for tablet 5a8edc898e45413484df91b064f36114 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260204 08:59:07.504549 18289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8edc898e45413484df91b064f36114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.510852 18569 tablet_bootstrap.cc:654] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:07.512681 18440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8edc898e45413484df91b064f36114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.513967 18432 tablet_service.cc:1505] Processing CreateTablet for tablet e09db0ac6e104e1e9a0ca7ebafab0cde (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260204 08:59:07.514930 18515 tablet_service.cc:1505] Processing CreateTablet for tablet 5d8340499d764f8cb6e95f63db6fb29f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260204 08:59:07.527571 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8340499d764f8cb6e95f63db6fb29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.525252 18366 tablet_service.cc:1505] Processing CreateTablet for tablet 6997ab65a1f44cd18707ec9e0afa05e9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260204 08:59:07.525589 18439 tablet_service.cc:1505] Processing CreateTablet for tablet 2b5fa3c805c64abf9a473724f41a0f29 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260204 08:59:07.544200 18439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5fa3c805c64abf9a473724f41a0f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.545806 18361 tablet_service.cc:1505] Processing CreateTablet for tablet e09db0ac6e104e1e9a0ca7ebafab0cde (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260204 08:59:07.547048 18361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09db0ac6e104e1e9a0ca7ebafab0cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.548594 18509 tablet_service.cc:1505] Processing CreateTablet for tablet ef72e5825eec43c3a4efa431934ec0e1 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260204 08:59:07.550094 18284 tablet_service.cc:1505] Processing CreateTablet for tablet 5d9e92ea8b0a4317bf54894cf1629480 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260204 08:59:07.548607 18441 tablet_service.cc:1505] Processing CreateTablet for tablet f643d3c57ebd457682398d38173a22c8 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260204 08:59:07.551460 18290 tablet_service.cc:1505] Processing CreateTablet for tablet 2b5fa3c805c64abf9a473724f41a0f29 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260204 08:59:07.552207 18441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f643d3c57ebd457682398d38173a22c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.552654 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5fa3c805c64abf9a473724f41a0f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.553431 18366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6997ab65a1f44cd18707ec9e0afa05e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.553777 18365 tablet_service.cc:1505] Processing CreateTablet for tablet 53c3327666de4ae08e91d63cc5af2259 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260204 08:59:07.550108 18364 tablet_service.cc:1505] Processing CreateTablet for tablet 5d9e92ea8b0a4317bf54894cf1629480 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260204 08:59:07.556890 18510 tablet_service.cc:1505] Processing CreateTablet for tablet 5ccfea57ae48454abf38341aee79315f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260204 08:59:07.560704 18437 tablet_service.cc:1505] Processing CreateTablet for tablet d17b9b554db3494a9c6594df37a1ab2f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260204 08:59:07.561134 18567 tablet_bootstrap.cc:654] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:07.561930 18437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17b9b554db3494a9c6594df37a1ab2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.564961 18363 tablet_service.cc:1505] Processing CreateTablet for tablet 5ccfea57ae48454abf38341aee79315f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260204 08:59:07.565258 18514 tablet_service.cc:1505] Processing CreateTablet for tablet 79332110ca7d46dd8fb7875471d3242d (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260204 08:59:07.566406 18436 tablet_service.cc:1505] Processing CreateTablet for tablet 53c3327666de4ae08e91d63cc5af2259 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260204 08:59:07.567636 18436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c3327666de4ae08e91d63cc5af2259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.550493 18509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef72e5825eec43c3a4efa431934ec0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.570149 18367 tablet_service.cc:1505] Processing CreateTablet for tablet f643d3c57ebd457682398d38173a22c8 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260204 08:59:07.571127 18360 tablet_service.cc:1505] Processing CreateTablet for tablet 79332110ca7d46dd8fb7875471d3242d (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260204 08:59:07.571488 18510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccfea57ae48454abf38341aee79315f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.554961 18365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c3327666de4ae08e91d63cc5af2259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.574791 18432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09db0ac6e104e1e9a0ca7ebafab0cde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.575933 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79332110ca7d46dd8fb7875471d3242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.576402 18570 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:07.513981 18511 tablet_service.cc:1505] Processing CreateTablet for tablet 447dfe3ea93642ff9abd0f55be77ea9b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260204 08:59:07.578771 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447dfe3ea93642ff9abd0f55be77ea9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.579075 18364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9e92ea8b0a4317bf54894cf1629480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.572669 18362 tablet_service.cc:1505] Processing CreateTablet for tablet 5a4f4307728d44029b19b3b03f406068 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260204 08:59:07.580968 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f643d3c57ebd457682398d38173a22c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.586346 18359 tablet_service.cc:1505] Processing CreateTablet for tablet f9d6ad3406784527a0e5f590724f204e (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260204 08:59:07.523036 18507 tablet_service.cc:1505] Processing CreateTablet for tablet 5a4f4307728d44029b19b3b03f406068 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260204 08:59:07.587730 18359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d6ad3406784527a0e5f590724f204e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.588431 18360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79332110ca7d46dd8fb7875471d3242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.590243 18284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9e92ea8b0a4317bf54894cf1629480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.590979 18363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccfea57ae48454abf38341aee79315f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.592903 18362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4f4307728d44029b19b3b03f406068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.595860 18507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4f4307728d44029b19b3b03f406068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.618184 18290 tablet_service.cc:1505] Processing CreateTablet for tablet d17b9b554db3494a9c6594df37a1ab2f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260204 08:59:07.619516 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17b9b554db3494a9c6594df37a1ab2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.620116 18327 heartbeater.cc:499] Master 127.15.3.254:37341 was elected leader, sending a full tablet report...
I20260204 08:59:07.625008 18435 tablet_service.cc:1505] Processing CreateTablet for tablet f93610353fcc43beabd7d2cf48df6a80 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260204 08:59:07.626258 18513 tablet_service.cc:1505] Processing CreateTablet for tablet 5a8edc898e45413484df91b064f36114 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260204 08:59:07.634819 18515 tablet_service.cc:1505] Processing CreateTablet for tablet 53c3327666de4ae08e91d63cc5af2259 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260204 08:59:07.636394 18432 tablet_service.cc:1505] Processing CreateTablet for tablet d7c5f3d791434f71a1cc75df662bd3c6 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260204 08:59:07.646411 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8edc898e45413484df91b064f36114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.655350 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c3327666de4ae08e91d63cc5af2259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.662055 18508 tablet_service.cc:1505] Processing CreateTablet for tablet 2b5fa3c805c64abf9a473724f41a0f29 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260204 08:59:07.663371 18508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5fa3c805c64abf9a473724f41a0f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.682740 18568 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:07.683282 18568 ts_tablet_manager.cc:1403] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.250s user 0.017s sys 0.026s
I20260204 08:59:07.686820 18568 raft_consensus.cc:359] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:07.692533 18286 tablet_service.cc:1505] Processing CreateTablet for tablet f93610353fcc43beabd7d2cf48df6a80 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260204 08:59:07.694108 18286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93610353fcc43beabd7d2cf48df6a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.687527 18568 raft_consensus.cc:385] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:07.695776 18568 raft_consensus.cc:740] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:07.700400 18402 heartbeater.cc:499] Master 127.15.3.254:37341 was elected leader, sending a full tablet report...
I20260204 08:59:07.700250 18570 tablet_bootstrap.cc:654] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:07.702975 18434 tablet_service.cc:1505] Processing CreateTablet for tablet 5ae192d61eb4439abaccb503d5b40dd4 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260204 08:59:07.679628 18435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93610353fcc43beabd7d2cf48df6a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.709458 18432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c5f3d791434f71a1cc75df662bd3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.694773 18506 tablet_service.cc:1505] Processing CreateTablet for tablet 5d9e92ea8b0a4317bf54894cf1629480 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260204 08:59:07.712989 18360 tablet_service.cc:1505] Processing CreateTablet for tablet d17b9b554db3494a9c6594df37a1ab2f (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260204 08:59:07.713719 18506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9e92ea8b0a4317bf54894cf1629480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.714290 18360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17b9b554db3494a9c6594df37a1ab2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.700546 18568 consensus_queue.cc:260] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:07.725426 18285 tablet_service.cc:1505] Processing CreateTablet for tablet 82eb988aa19440f9ae575f7f9d90287d (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260204 08:59:07.726008 18440 tablet_service.cc:1505] Processing CreateTablet for tablet 263a60191abd44948307685e71fc6321 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260204 08:59:07.727180 18283 tablet_service.cc:1505] Processing CreateTablet for tablet 64ea22ea98194ddba012eb97da4ef833 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260204 08:59:07.728396 18434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae192d61eb4439abaccb503d5b40dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.686980 18288 tablet_service.cc:1505] Processing CreateTablet for tablet 5ae192d61eb4439abaccb503d5b40dd4 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260204 08:59:07.721175 18366 tablet_service.cc:1505] Processing CreateTablet for tablet 82eb988aa19440f9ae575f7f9d90287d (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260204 08:59:07.744591 18569 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:07.744696 18570 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:07.748966 18290 tablet_service.cc:1505] Processing CreateTablet for tablet 263a60191abd44948307685e71fc6321 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260204 08:59:07.749997 18285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82eb988aa19440f9ae575f7f9d90287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.751469 18438 tablet_service.cc:1505] Processing CreateTablet for tablet 05f065f08b15420e8394a3226291d518 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260204 08:59:07.756456 18292 tablet_service.cc:1505] Processing CreateTablet for tablet d25eb84b22c4469996abd8629863c279 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260204 08:59:07.756976 18291 tablet_service.cc:1505] Processing CreateTablet for tablet f4a90ced875b42b0be979d1dc8a5d977 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260204 08:59:07.759969 18509 tablet_service.cc:1505] Processing CreateTablet for tablet f643d3c57ebd457682398d38173a22c8 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260204 08:59:07.760108 18358 tablet_service.cc:1505] Processing CreateTablet for tablet d7c5f3d791434f71a1cc75df662bd3c6 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260204 08:59:07.772019 18570 ts_tablet_manager.cc:1403] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.196s user 0.011s sys 0.003s
I20260204 08:59:07.772184 18366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82eb988aa19440f9ae575f7f9d90287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.772480 18569 ts_tablet_manager.cc:1403] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.303s user 0.011s sys 0.013s
I20260204 08:59:07.777174 18509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f643d3c57ebd457682398d38173a22c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.780346 18358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c5f3d791434f71a1cc75df662bd3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.781972 18439 tablet_service.cc:1505] Processing CreateTablet for tablet d25eb84b22c4469996abd8629863c279 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260204 08:59:07.782162 18569 raft_consensus.cc:359] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:07.782814 18569 raft_consensus.cc:385] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:07.783114 18569 raft_consensus.cc:740] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:07.783876 18569 consensus_queue.cc:260] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:07.779245 18570 raft_consensus.cc:359] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:07.785337 18570 raft_consensus.cc:385] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:07.785636 18570 raft_consensus.cc:740] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:07.788825 18364 tablet_service.cc:1505] Processing CreateTablet for tablet 64ea22ea98194ddba012eb97da4ef833 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260204 08:59:07.790138 18283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ea22ea98194ddba012eb97da4ef833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.793222 18364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ea22ea98194ddba012eb97da4ef833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.790401 18514 tablet_service.cc:1505] Processing CreateTablet for tablet d7c5f3d791434f71a1cc75df662bd3c6 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260204 08:59:07.795125 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c5f3d791434f71a1cc75df662bd3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.800473 18510 tablet_service.cc:1505] Processing CreateTablet for tablet 82eb988aa19440f9ae575f7f9d90287d (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260204 08:59:07.802439 18510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82eb988aa19440f9ae575f7f9d90287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.803367 18438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f065f08b15420e8394a3226291d518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.804996 18476 heartbeater.cc:499] Master 127.15.3.254:37341 was elected leader, sending a full tablet report...
I20260204 08:59:07.806461 18436 tablet_service.cc:1505] Processing CreateTablet for tablet 58a571d216c1493aae70dbd574c45d22 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260204 08:59:07.807623 18436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a571d216c1493aae70dbd574c45d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.816305 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263a60191abd44948307685e71fc6321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.829910 18439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25eb84b22c4469996abd8629863c279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.820533 18362 tablet_service.cc:1505] Processing CreateTablet for tablet d25eb84b22c4469996abd8629863c279 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260204 08:59:07.821050 18515 tablet_service.cc:1505] Processing CreateTablet for tablet 64ea22ea98194ddba012eb97da4ef833 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260204 08:59:07.834898 18288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae192d61eb4439abaccb503d5b40dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.835896 18567 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:07.839591 18569 ts_tablet_manager.cc:1434] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.062s user 0.004s sys 0.005s
I20260204 08:59:07.826954 18570 consensus_queue.cc:260] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:07.840739 18362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25eb84b22c4469996abd8629863c279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.775463 18512 tablet_service.cc:1505] Processing CreateTablet for tablet f93610353fcc43beabd7d2cf48df6a80 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260204 08:59:07.826773 18511 tablet_service.cc:1505] Processing CreateTablet for tablet 263a60191abd44948307685e71fc6321 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260204 08:59:07.819200 18432 tablet_service.cc:1505] Processing CreateTablet for tablet b53e40eb77df4f698c18c0d12effd872 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260204 08:59:07.815542 18437 tablet_service.cc:1505] Processing CreateTablet for tablet b535c4ca953b4013861502cf99c90b2b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260204 08:59:07.808043 18365 tablet_service.cc:1505] Processing CreateTablet for tablet 5ae192d61eb4439abaccb503d5b40dd4 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260204 08:59:07.865058 18365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae192d61eb4439abaccb503d5b40dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.865146 18507 tablet_service.cc:1505] Processing CreateTablet for tablet 05f065f08b15420e8394a3226291d518 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260204 08:59:07.836135 18363 tablet_service.cc:1505] Processing CreateTablet for tablet f4a90ced875b42b0be979d1dc8a5d977 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260204 08:59:07.868348 18363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a90ced875b42b0be979d1dc8a5d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.874712 18509 tablet_service.cc:1505] Processing CreateTablet for tablet f4a90ced875b42b0be979d1dc8a5d977 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260204 08:59:07.842651 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ea22ea98194ddba012eb97da4ef833. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:59:07.850806 18328 tablet.cc:2378] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260204 08:59:07.851181 18291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a90ced875b42b0be979d1dc8a5d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.843068 18567 ts_tablet_manager.cc:1403] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.365s user 0.010s sys 0.011s
I20260204 08:59:07.888154 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93610353fcc43beabd7d2cf48df6a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.889875 18507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f065f08b15420e8394a3226291d518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.890383 18567 raft_consensus.cc:359] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:07.891119 18567 raft_consensus.cc:385] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:07.891402 18567 raft_consensus.cc:740] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:07.891927 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263a60191abd44948307685e71fc6321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.892213 18567 consensus_queue.cc:260] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:07.841789 18433 tablet_service.cc:1505] Processing CreateTablet for tablet 22576b5cf9c246408bb6b297c9f03412 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260204 08:59:07.856102 18284 tablet_service.cc:1505] Processing CreateTablet for tablet 58a571d216c1493aae70dbd574c45d22 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260204 08:59:07.857139 18359 tablet_service.cc:1505] Processing CreateTablet for tablet b535c4ca953b4013861502cf99c90b2b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260204 08:59:07.859212 18289 tablet_service.cc:1505] Processing CreateTablet for tablet 17155b1b19aa43f291361bcd323bf470 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260204 08:59:07.859321 18367 tablet_service.cc:1505] Processing CreateTablet for tablet b53e40eb77df4f698c18c0d12effd872 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260204 08:59:07.860100 18568 ts_tablet_manager.cc:1434] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.177s user 0.011s sys 0.007s
I20260204 08:59:07.814272 18360 tablet_service.cc:1505] Processing CreateTablet for tablet 05f065f08b15420e8394a3226291d518 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260204 08:59:07.893951 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25eb84b22c4469996abd8629863c279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.898530 18286 tablet_service.cc:1505] Processing CreateTablet for tablet 22576b5cf9c246408bb6b297c9f03412 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260204 08:59:07.861595 18361 tablet_service.cc:1505] Processing CreateTablet for tablet 17155b1b19aa43f291361bcd323bf470 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260204 08:59:07.809564 18513 tablet_service.cc:1505] Processing CreateTablet for tablet 17155b1b19aa43f291361bcd323bf470 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260204 08:59:07.892577 18550 heartbeater.cc:499] Master 127.15.3.254:37341 was elected leader, sending a full tablet report...
I20260204 08:59:07.900380 18568 tablet_bootstrap.cc:492] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:07.855020 18287 tablet_service.cc:1505] Processing CreateTablet for tablet b53e40eb77df4f698c18c0d12effd872 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260204 08:59:07.904285 18284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a571d216c1493aae70dbd574c45d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.908393 18441 tablet_service.cc:1505] Processing CreateTablet for tablet 1b2ad7461fbe43dea33bdbb755e246c9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260204 08:59:07.896950 18577 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:07.893648 18440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263a60191abd44948307685e71fc6321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.910938 18569 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:07.912809 18287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53e40eb77df4f698c18c0d12effd872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.939806 18433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22576b5cf9c246408bb6b297c9f03412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.940645 18576 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:07.941110 18576 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:07.914034 18285 tablet_service.cc:1505] Processing CreateTablet for tablet e65e67a60cd24f02a3f66afc76e2b5f0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260204 08:59:07.921758 18358 tablet_service.cc:1505] Processing CreateTablet for tablet 1b2ad7461fbe43dea33bdbb755e246c9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260204 08:59:07.931246 18508 tablet_service.cc:1505] Processing CreateTablet for tablet 58a571d216c1493aae70dbd574c45d22 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260204 08:59:07.939014 18509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a90ced875b42b0be979d1dc8a5d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.939427 18577 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:07.916160 18361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17155b1b19aa43f291361bcd323bf470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.943427 18576 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:07.953676 18289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17155b1b19aa43f291361bcd323bf470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.965916 18358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b2ad7461fbe43dea33bdbb755e246c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.966574 18568 tablet_bootstrap.cc:654] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:07.967983 18360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f065f08b15420e8394a3226291d518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.977869 18568 tablet_bootstrap.cc:492] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:07.930874 18506 tablet_service.cc:1505] Processing CreateTablet for tablet b535c4ca953b4013861502cf99c90b2b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260204 08:59:07.970927 18437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b535c4ca953b4013861502cf99c90b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.981360 18568 ts_tablet_manager.cc:1403] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.081s user 0.007s sys 0.005s
I20260204 08:59:07.983911 18567 ts_tablet_manager.cc:1434] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.096s user 0.016s sys 0.008s
I20260204 08:59:07.984762 18510 tablet_service.cc:1505] Processing CreateTablet for tablet 22576b5cf9c246408bb6b297c9f03412 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260204 08:59:07.985553 18439 tablet_service.cc:1505] Processing CreateTablet for tablet e65e67a60cd24f02a3f66afc76e2b5f0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260204 08:59:07.989316 18577 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:07.978615 18286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22576b5cf9c246408bb6b297c9f03412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.994832 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17155b1b19aa43f291361bcd323bf470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:07.998041 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53e40eb77df4f698c18c0d12effd872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.071321 18570 ts_tablet_manager.cc:1434] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.294s user 0.004s sys 0.014s
I20260204 08:59:08.082209 18508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a571d216c1493aae70dbd574c45d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.084609 18359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b535c4ca953b4013861502cf99c90b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.084560 18362 tablet_service.cc:1505] Processing CreateTablet for tablet e65e67a60cd24f02a3f66afc76e2b5f0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260204 08:59:08.085894 18362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65e67a60cd24f02a3f66afc76e2b5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.087924 18575 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:08.088389 18575 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:08.080300 18567 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:08.080826 18432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53e40eb77df4f698c18c0d12effd872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.100376 18575 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:08.122942 18439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65e67a60cd24f02a3f66afc76e2b5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.107471 18283 tablet_service.cc:1505] Processing CreateTablet for tablet 097dd514c346448db7708716b992ea2c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260204 08:59:08.127801 18506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b535c4ca953b4013861502cf99c90b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.116477 18285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65e67a60cd24f02a3f66afc76e2b5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.138960 18569 tablet_bootstrap.cc:654] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.141850 18366 tablet_service.cc:1505] Processing CreateTablet for tablet a76dccca152648179027ee96bc473ad7 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260204 08:59:08.143138 18366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76dccca152648179027ee96bc473ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.145756 18288 tablet_service.cc:1505] Processing CreateTablet for tablet 56f846ea1dc8409290d5635d9ec149d0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260204 08:59:08.146950 18288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f846ea1dc8409290d5635d9ec149d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.148485 18290 tablet_service.cc:1505] Processing CreateTablet for tablet e2a0fe8603cb44c8879dce83514090c0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260204 08:59:08.148871 18284 tablet_service.cc:1505] Processing CreateTablet for tablet 8b58fa367186430c9ecb96a31021923c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260204 08:59:08.150233 18284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b58fa367186430c9ecb96a31021923c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.156741 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a0fe8603cb44c8879dce83514090c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.160329 18441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b2ad7461fbe43dea33bdbb755e246c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.164280 18365 tablet_service.cc:1505] Processing CreateTablet for tablet 2386346b21154761adcf3b5b27f8e2dc (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260204 08:59:08.138849 18361 tablet_service.cc:1505] Processing CreateTablet for tablet 097dd514c346448db7708716b992ea2c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260204 08:59:08.077471 18568 raft_consensus.cc:359] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:08.155148 18287 tablet_service.cc:1505] Processing CreateTablet for tablet f4f47e43eb8c44a19193f49d4f8d66ec (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260204 08:59:08.196316 18187 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 77047.4us
I20260204 08:59:08.196771 18570 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:08.214991 18515 tablet_service.cc:1505] Processing CreateTablet for tablet e2a0fe8603cb44c8879dce83514090c0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260204 08:59:08.216348 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a0fe8603cb44c8879dce83514090c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.219779 18292 tablet_service.cc:1505] Processing CreateTablet for tablet 2386346b21154761adcf3b5b27f8e2dc (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260204 08:59:08.220992 18512 tablet_service.cc:1505] Processing CreateTablet for tablet a76dccca152648179027ee96bc473ad7 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260204 08:59:08.222265 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76dccca152648179027ee96bc473ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.240983 18511 tablet_service.cc:1505] Processing CreateTablet for tablet 8b58fa367186430c9ecb96a31021923c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260204 08:59:08.193323 18568 raft_consensus.cc:385] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.250638 18510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22576b5cf9c246408bb6b297c9f03412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.253173 18567 tablet_bootstrap.cc:654] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.242437 18283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097dd514c346448db7708716b992ea2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.243785 18568 raft_consensus.cc:740] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:08.280270 18365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2386346b21154761adcf3b5b27f8e2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.281888 18511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b58fa367186430c9ecb96a31021923c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.286288 18438 tablet_service.cc:1505] Processing CreateTablet for tablet a76dccca152648179027ee96bc473ad7 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260204 08:59:08.287535 18438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76dccca152648179027ee96bc473ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.290490 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2386346b21154761adcf3b5b27f8e2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.291707 18287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f47e43eb8c44a19193f49d4f8d66ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.294276 18514 tablet_service.cc:1505] Processing CreateTablet for tablet 097dd514c346448db7708716b992ea2c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260204 08:59:08.295473 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097dd514c346448db7708716b992ea2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.268620 18570 tablet_bootstrap.cc:654] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.300042 18434 tablet_service.cc:1505] Processing CreateTablet for tablet e2a0fe8603cb44c8879dce83514090c0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260204 08:59:08.301227 18434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a0fe8603cb44c8879dce83514090c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.304412 18435 tablet_service.cc:1505] Processing CreateTablet for tablet 56f846ea1dc8409290d5635d9ec149d0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260204 08:59:08.305554 18435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f846ea1dc8409290d5635d9ec149d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.313023 18361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097dd514c346448db7708716b992ea2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.317341 18568 consensus_queue.cc:260] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:08.324455 18364 tablet_service.cc:1505] Processing CreateTablet for tablet 8b58fa367186430c9ecb96a31021923c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260204 08:59:08.325659 18364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b58fa367186430c9ecb96a31021923c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.327436 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:08.331938 18507 tablet_service.cc:1505] Processing CreateTablet for tablet 1b2ad7461fbe43dea33bdbb755e246c9 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260204 08:59:08.333197 18507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b2ad7461fbe43dea33bdbb755e246c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.319532 18568 ts_tablet_manager.cc:1434] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.324s user 0.006s sys 0.001s
W20260204 08:59:08.343143 18265 leader_election.cc:343] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.343353 18579 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:08.352636 18436 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 28) took 1048 ms. Trace:
I20260204 08:59:08.352550 18579 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:08.353394 18363 tablet_service.cc:1505] Processing CreateTablet for tablet 56f846ea1dc8409290d5635d9ec149d0 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260204 08:59:08.354123 18286 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 32) took 1021 ms. Trace:
I20260204 08:59:08.354591 18359 tablet_service.cc:1505] Processing CreateTablet for tablet 386fda89477c4d2e8f27ed60e5176a24 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260204 08:59:08.354514 18286 rpcz_store.cc:276] 0204 08:59:07.333081 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.897674 (+564593us) service_pool.cc:225] Handling call
0204 08:59:07.919941 (+ 22267us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b5800000998. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd41b541 00007fcebd3f87d3 00007fcebd3a74c9 00007fceb6837bf4 00007fceb6837b82 00007fceb6837ab1
0204 08:59:07.920077 (+ 136us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.920168 (+ 91us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.288906 (+368738us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.353627 (+ 64721us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.354064 (+ 437us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18122624}
I20260204 08:59:08.356663 18286 tablet_service.cc:1505] Processing CreateTablet for tablet 386fda89477c4d2e8f27ed60e5176a24 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260204 08:59:08.354628 18363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f846ea1dc8409290d5635d9ec149d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.353137 18436 rpcz_store.cc:276] 0204 08:59:07.304557 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.805584 (+501027us) service_pool.cc:225] Handling call
0204 08:59:07.807208 (+ 1624us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.807297 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.161367 (+354070us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.319560 (+158193us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.352573 (+ 33013us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.378140 18286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386fda89477c4d2e8f27ed60e5176a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.382200 18439 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 33) took 1038 ms. Trace:
I20260204 08:59:08.387579 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:08.388923 18359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386fda89477c4d2e8f27ed60e5176a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.390377 18568 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:08.371146 18291 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 28) took 1053 ms. Trace:
I20260204 08:59:08.394435 18291 rpcz_store.cc:276] 0204 08:59:07.318172 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.756153 (+437981us) service_pool.cc:225] Handling call
0204 08:59:07.796218 (+ 40065us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5800000998. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd41b541 00007fcebd3f87d3 00007fcebd3a74c9 00007fceb6837bf4 00007fceb6837b82 00007fceb6837ab1
0204 08:59:07.816345 (+ 20127us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.816441 (+ 96us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.080875 (+264434us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.363296 (+282421us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.370467 (+ 7171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":23168768}
I20260204 08:59:08.375535 18436 tablet_service.cc:1505] Processing CreateTablet for tablet f4f47e43eb8c44a19193f49d4f8d66ec (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260204 08:59:08.402729 18513 tablet_service.cc:1505] Processing CreateTablet for tablet cfa617c4afef4c2f958395c561a1c8b5 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260204 08:59:08.387403 18439 rpcz_store.cc:276] 0204 08:59:07.343846 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.984701 (+640855us) service_pool.cc:225] Handling call
0204 08:59:08.076926 (+ 92225us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.082557 (+ 5631us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.330706 (+248149us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.363545 (+ 32839us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.382129 (+ 18584us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.416105 18439 tablet_service.cc:1505] Processing CreateTablet for tablet cfa617c4afef4c2f958395c561a1c8b5 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260204 08:59:08.431447 18515 tablet_service.cc:1505] Processing CreateTablet for tablet f4f47e43eb8c44a19193f49d4f8d66ec (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260204 08:59:08.432123 18291 tablet_service.cc:1505] Processing CreateTablet for tablet a934695b181f40f0a55ece7603079f63 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260204 08:59:08.432765 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f47e43eb8c44a19193f49d4f8d66ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.433359 18291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a934695b181f40f0a55ece7603079f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.437237 18362 tablet_service.cc:1505] Processing CreateTablet for tablet 72802a089d72492ca11d2d83ae08413c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260204 08:59:08.438428 18362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72802a089d72492ca11d2d83ae08413c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.440704 18287 tablet_service.cc:1505] Processing CreateTablet for tablet 3b84b4beaf8a4f0ba8732c09d4230b3b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260204 08:59:08.441886 18358 tablet_service.cc:1505] Processing CreateTablet for tablet 3b84b4beaf8a4f0ba8732c09d4230b3b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260204 08:59:08.443080 18358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b84b4beaf8a4f0ba8732c09d4230b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.412295 18579 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:08.444353 18289 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 31) took 1117 ms. Trace:
I20260204 08:59:08.444773 18289 rpcz_store.cc:276] 0204 08:59:07.326699 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.858165 (+531466us) service_pool.cc:225] Handling call
0204 08:59:07.914148 (+ 55983us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5800000998. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd41b541 00007fcebd3f87d3 00007fcebd3a74c9 00007fceb6837bf4 00007fceb6837b82 00007fceb6837ab1
0204 08:59:07.914279 (+ 131us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.914361 (+ 82us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.226583 (+312222us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.386305 (+159722us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.444298 (+ 57993us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":31411072}
I20260204 08:59:08.446552 18513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa617c4afef4c2f958395c561a1c8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.446803 18289 tablet_service.cc:1505] Processing CreateTablet for tablet c2817d87504042fba8cda4e4e352c571 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260204 08:59:08.448302 18506 tablet_service.cc:1505] Processing CreateTablet for tablet 386fda89477c4d2e8f27ed60e5176a24 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260204 08:59:08.448415 18365 tablet_service.cc:1505] Processing CreateTablet for tablet cfa617c4afef4c2f958395c561a1c8b5 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260204 08:59:08.449524 18506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386fda89477c4d2e8f27ed60e5176a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.449811 18365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa617c4afef4c2f958395c561a1c8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.452402 18440 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 25) took 1168 ms. Trace:
I20260204 08:59:08.452783 18440 rpcz_store.cc:276] 0204 08:59:07.283537 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.725117 (+441580us) service_pool.cc:225] Handling call
0204 08:59:07.727620 (+ 2503us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.749100 (+ 21480us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.153173 (+404073us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.388476 (+235303us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.452344 (+ 63868us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.453913 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:08.465853 18568 tablet_bootstrap.cc:654] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.467376 18437 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 29) took 1160 ms. Trace:
I20260204 08:59:08.467769 18437 rpcz_store.cc:276] 0204 08:59:07.307195 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.814703 (+507508us) service_pool.cc:225] Handling call
0204 08:59:07.865577 (+ 50874us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.865674 (+ 97us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.286233 (+420559us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.398301 (+112068us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.467322 (+ 69021us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.441895 18287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b84b4beaf8a4f0ba8732c09d4230b3b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:59:08.463424 18187 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 67644us
I20260204 08:59:08.472316 18285 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 33) took 1132 ms. Trace:
I20260204 08:59:08.472900 18283 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 34) took 1125 ms. Trace:
I20260204 08:59:08.473273 18283 rpcz_store.cc:276] 0204 08:59:07.347053 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.098811 (+751758us) service_pool.cc:225] Handling call
0204 08:59:08.128064 (+ 29253us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.128165 (+ 101us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.395691 (+267526us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.472428 (+ 76737us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.472846 (+ 418us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 08:59:08.475301 18248 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260204 08:59:08.476361 18340 leader_election.cc:343] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.477416 18436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f47e43eb8c44a19193f49d4f8d66ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.478032 18567 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:08.478528 18567 ts_tablet_manager.cc:1403] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.474s user 0.027s sys 0.040s
I20260204 08:59:08.468333 18440 tablet_service.cc:1505] Processing CreateTablet for tablet 2386346b21154761adcf3b5b27f8e2dc (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260204 08:59:08.479610 18440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2386346b21154761adcf3b5b27f8e2dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260204 08:59:08.480361 18265 leader_election.cc:343] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.480788 18265 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:08.481667 18289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2817d87504042fba8cda4e4e352c571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.481416 18508 tablet_service.cc:1505] Processing CreateTablet for tablet 0d40b352c1b54b1e875dc8a41b09f865 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260204 08:59:08.481772 18439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa617c4afef4c2f958395c561a1c8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.464869 18432 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 30) took 1146 ms. Trace:
I20260204 08:59:08.482928 18432 rpcz_store.cc:276] 0204 08:59:07.317604 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.818374 (+500770us) service_pool.cc:225] Handling call
0204 08:59:07.859932 (+ 41558us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.860030 (+ 98us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.306045 (+446015us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.366903 (+ 60858us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.463799 (+ 96896us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.483978 18433 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 31) took 1154 ms. Trace:
I20260204 08:59:08.484340 18433 rpcz_store.cc:276] 0204 08:59:07.329962 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.840958 (+510996us) service_pool.cc:225] Handling call
0204 08:59:07.897288 (+ 56330us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.897389 (+ 101us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.159432 (+262043us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.383726 (+224294us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.425607 (+ 41881us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb53043e2 00007fcebe1e0189 00007fcebd336108 00007fcebd3fc683 00007fcebd3f841f 00007fcebd3f8bdd 00007fcebd3a74c9 00007fceb6837bf4 00007fceb6837b82
0204 08:59:08.483919 (+ 58312us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2015,"spinlock_wait_cycles":12798336}
I20260204 08:59:08.484885 18432 tablet_service.cc:1505] Processing CreateTablet for tablet 72802a089d72492ca11d2d83ae08413c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260204 08:59:08.486039 18432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72802a089d72492ca11d2d83ae08413c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.486251 18433 tablet_service.cc:1505] Processing CreateTablet for tablet a934695b181f40f0a55ece7603079f63 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260204 08:59:08.499413 18433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a934695b181f40f0a55ece7603079f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.500828 18508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d40b352c1b54b1e875dc8a41b09f865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.472684 18285 rpcz_store.cc:276] 0204 08:59:07.340358 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.913206 (+572848us) service_pool.cc:225] Handling call
0204 08:59:07.960400 (+ 47194us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.972488 (+ 12088us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.356491 (+384003us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.471852 (+115361us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.472264 (+ 412us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.502624 18285 tablet_service.cc:1505] Processing CreateTablet for tablet 0d40b352c1b54b1e875dc8a41b09f865 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260204 08:59:08.520001 18285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d40b352c1b54b1e875dc8a41b09f865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.520610 18437 tablet_service.cc:1505] Processing CreateTablet for tablet 3b84b4beaf8a4f0ba8732c09d4230b3b (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260204 08:59:08.522006 18437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b84b4beaf8a4f0ba8732c09d4230b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.532460 18570 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:08.533109 18570 ts_tablet_manager.cc:1403] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.337s user 0.014s sys 0.000s
I20260204 08:59:08.552312 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:08.554010 18491 leader_election.cc:343] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.555408 18367 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 30) took 1085 ms. Trace:
I20260204 08:59:08.555847 18367 rpcz_store.cc:276] 0204 08:59:07.470313 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.858528 (+388215us) service_pool.cc:225] Handling call
0204 08:59:07.923110 (+ 64582us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.923210 (+ 100us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.231575 (+308365us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.420333 (+188758us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.555346 (+135013us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.557757 18367 tablet_service.cc:1505] Processing CreateTablet for tablet c2817d87504042fba8cda4e4e352c571 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260204 08:59:08.558974 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2817d87504042fba8cda4e4e352c571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.560560 18567 raft_consensus.cc:359] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:08.561247 18567 raft_consensus.cc:385] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.561538 18567 raft_consensus.cc:740] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:08.561982 18434 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 34) took 1211 ms. Trace:
I20260204 08:59:08.562366 18434 rpcz_store.cc:276] 0204 08:59:07.350452 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.256228 (+905776us) service_pool.cc:225] Handling call
0204 08:59:08.300808 (+ 44580us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.300904 (+ 96us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.423500 (+122596us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.561511 (+138011us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.561931 (+ 420us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 08:59:08.564289 18184 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 116180us
I20260204 08:59:08.565114 18569 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:08.565599 18569 ts_tablet_manager.cc:1403] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.655s user 0.014s sys 0.014s
I20260204 08:59:08.571561 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:08.573415 18488 leader_election.cc:343] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.574054 18488 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:08.574728 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:08.575192 18577 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260204 08:59:08.575968 18343 leader_election.cc:343] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.576407 18343 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:08.577431 18575 raft_consensus.cc:2749] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260204 08:59:08.573454 18187 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 102579us
I20260204 08:59:08.581923 18438 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 35) took 1193 ms. Trace:
I20260204 08:59:08.582335 18438 rpcz_store.cc:276] 0204 08:59:07.388112 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.260002 (+871890us) service_pool.cc:225] Handling call
0204 08:59:08.287103 (+ 27101us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.287193 (+ 90us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.443526 (+156333us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.581440 (+137914us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.581865 (+ 425us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.585522 18292 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 39) took 1129 ms. Trace:
I20260204 08:59:08.585932 18292 rpcz_store.cc:276] 0204 08:59:07.456246 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.217721 (+761475us) service_pool.cc:225] Handling call
0204 08:59:08.221479 (+ 3758us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.221681 (+ 202us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.428374 (+206693us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.585061 (+156687us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.585465 (+ 404us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.586805 18288 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 36) took 1166 ms. Trace:
I20260204 08:59:08.587186 18288 rpcz_store.cc:276] 0204 08:59:07.393550 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.144876 (+751326us) service_pool.cc:225] Handling call
0204 08:59:08.146524 (+ 1648us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.146610 (+ 86us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.437890 (+291280us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.559177 (+121287us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.559600 (+ 423us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.588709 18569 raft_consensus.cc:359] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:08.589401 18569 raft_consensus.cc:385] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.589681 18569 raft_consensus.cc:740] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:08.590109 18290 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 35) took 1213 ms. Trace:
I20260204 08:59:08.590517 18290 rpcz_store.cc:276] 0204 08:59:07.376293 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.120206 (+743913us) service_pool.cc:225] Handling call
0204 08:59:08.156331 (+ 36125us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.156419 (+ 88us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.385270 (+228851us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.589490 (+204220us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.590054 (+ 564us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.593636 18510 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 31) took 1103 ms. Trace:
I20260204 08:59:08.597195 18515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 37) took 1047 ms. Trace:
I20260204 08:59:08.597512 18569 consensus_queue.cc:260] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:08.605194 18360 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 26) took 1158 ms. Trace:
I20260204 08:59:08.607589 18575 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:08.608174 18284 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 37) took 1202 ms. Trace:
I20260204 08:59:08.629987 18360 rpcz_store.cc:276] 0204 08:59:07.463751 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.813458 (+349707us) service_pool.cc:225] Handling call
0204 08:59:07.916656 (+103198us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.916760 (+ 104us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.375212 (+458452us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.604707 (+229495us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.605138 (+ 431us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.632226 18284 rpcz_store.cc:276] 0204 08:59:07.405454 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.147924 (+742470us) service_pool.cc:225] Handling call
0204 08:59:08.149760 (+ 1836us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.149860 (+ 100us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.396879 (+247019us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.607113 (+210234us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.608121 (+ 1008us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.610601 18514 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 33) took 1120 ms. Trace:
I20260204 08:59:08.612246 18570 raft_consensus.cc:359] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.634434 18570 raft_consensus.cc:385] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.634747 18570 raft_consensus.cc:740] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:08.582041 18366 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 35) took 1110 ms. Trace:
I20260204 08:59:08.611450 18441 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 32) took 1274 ms. Trace:
I20260204 08:59:08.636049 18366 rpcz_store.cc:276] 0204 08:59:07.471840 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.141015 (+669175us) service_pool.cc:225] Handling call
0204 08:59:08.142701 (+ 1686us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.142803 (+ 102us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.367235 (+224432us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.581566 (+214331us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.581973 (+ 407us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.629707 18515 rpcz_store.cc:276] 0204 08:59:07.550318 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.430534 (+880216us) service_pool.cc:225] Handling call
0204 08:59:08.432321 (+ 1787us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.432411 (+ 90us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.453790 (+ 21379us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.596738 (+142948us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.597140 (+ 402us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.640264 18515 tablet_service.cc:1505] Processing CreateTablet for tablet a934695b181f40f0a55ece7603079f63 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260204 08:59:08.641467 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a934695b181f40f0a55ece7603079f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.634248 18514 rpcz_store.cc:276] 0204 08:59:07.490652 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.211855 (+721203us) service_pool.cc:225] Handling call
0204 08:59:08.295058 (+ 83203us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.295149 (+ 91us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.474668 (+179519us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.610152 (+135484us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.610548 (+ 396us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.618255 18512 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 35) took 1127 ms. Trace:
I20260204 08:59:08.562196 18567 consensus_queue.cc:260] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:08.621119 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:08.624676 18507 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 32) took 1134 ms. Trace:
I20260204 08:59:08.625439 18434 tablet_service.cc:1505] Processing CreateTablet for tablet 0d40b352c1b54b1e875dc8a41b09f865 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260204 08:59:08.630131 18575 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:08.643708 18441 rpcz_store.cc:276] 0204 08:59:07.337428 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.907474 (+570046us) service_pool.cc:225] Handling call
0204 08:59:07.909202 (+ 1728us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.909298 (+ 96us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.500789 (+591491us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.611006 (+110217us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.611396 (+ 390us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.635577 18570 consensus_queue.cc:260] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.646240 18435 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 36) took 1249 ms. Trace:
I20260204 08:59:08.627851 18510 rpcz_store.cc:276] 0204 08:59:07.490112 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.983071 (+492959us) service_pool.cc:225] Handling call
0204 08:59:08.084247 (+101176us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb53040dc 00007fceb5303c9b 00007fcebe1b6dd9 00007fcebd336260 00007fcebd41b541 00007fcebd3f87d3 00007fcebd3a74c9 00007fceb6837bf4 00007fceb6837b82 00007fceb6837ab1
0204 08:59:08.192785 (+108538us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.211691 (+ 18906us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.422576 (+210885us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.593112 (+170536us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.593583 (+ 471us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":97720576}
I20260204 08:59:08.655290 18286 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 40) took 1178 ms. Trace:
I20260204 08:59:08.664693 18365 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 38) took 1192 ms. Trace:
I20260204 08:59:08.635445 18509 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 27) took 1146 ms. Trace:
I20260204 08:59:08.660739 18512 rpcz_store.cc:276] 0204 08:59:07.491247 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.220136 (+728889us) service_pool.cc:225] Handling call
0204 08:59:08.221845 (+ 1709us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.221933 (+ 88us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.585785 (+363852us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.617801 (+ 32016us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.618203 (+ 402us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.664880 18513 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 38) took 1114 ms. Trace:
I20260204 08:59:08.668556 18511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 36) took 1176 ms. Trace:
I20260204 08:59:08.674414 18358 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 42) took 1188 ms. Trace:
I20260204 08:59:08.692202 18434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d40b352c1b54b1e875dc8a41b09f865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.676551 18600 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:08.693730 18567 ts_tablet_manager.cc:1434] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.215s user 0.014s sys 0.002s
I20260204 08:59:08.723145 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:08.675968 18265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 194363us
I20260204 08:59:08.689181 18570 ts_tablet_manager.cc:1434] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.156s user 0.006s sys 0.000s
I20260204 08:59:08.687585 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:08.700939 18568 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:08.693059 18437 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 42) took 1206 ms. Trace:
I20260204 08:59:08.680549 18364 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 37) took 1208 ms. Trace:
I20260204 08:59:08.676980 18510 tablet_service.cc:1505] Processing CreateTablet for tablet c2817d87504042fba8cda4e4e352c571 (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260204 08:59:08.732571 18285 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 44) took 1229 ms. Trace:
I20260204 08:59:08.691340 18440 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 39) took 1237 ms. Trace:
I20260204 08:59:08.696969 18436 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 37) took 1285 ms. Trace:
I20260204 08:59:08.687948 18359 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 40) took 1209 ms. Trace:
I20260204 08:59:08.703482 18363 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 36) took 1231 ms. Trace:
I20260204 08:59:08.691306 18508 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 43) took 1139 ms. Trace:
I20260204 08:59:08.695128 18362 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 41) took 1216 ms. Trace:
W20260204 08:59:08.689365 18414 leader_election.cc:343] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.700917 18361 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 34) took 1229 ms. Trace:
I20260204 08:59:08.717778 18287 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 42) took 1234 ms. Trace:
I20260204 08:59:08.696113 18433 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 40) took 1218 ms. Trace:
I20260204 08:59:08.684598 18575 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:08.668292 18435 rpcz_store.cc:276] 0204 08:59:07.396848 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.262371 (+865523us) service_pool.cc:225] Handling call
0204 08:59:08.305164 (+ 42793us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.305246 (+ 82us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.576873 (+271627us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.645762 (+ 68889us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.646186 (+ 424us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.795608 18569 ts_tablet_manager.cc:1434] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.230s user 0.011s sys 0.003s
I20260204 08:59:08.664484 18507 rpcz_store.cc:276] 0204 08:59:07.490374 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.200309 (+709935us) service_pool.cc:225] Handling call
0204 08:59:08.332747 (+132438us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.332846 (+ 99us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.588452 (+255606us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.624225 (+ 35773us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.624624 (+ 399us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.732928 18439 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 38) took 1280 ms. Trace:
I20260204 08:59:08.676573 18514 tablet_service.cc:1505] Processing CreateTablet for tablet 72802a089d72492ca11d2d83ae08413c (DEFAULT_TABLE table=test-workload [id=3d01e0bf13194f649685c24f2ff10352]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260204 08:59:08.725955 18515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 40) took 1174 ms. Trace:
I20260204 08:59:08.804612 18291 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 41) took 1327 ms. Trace:
I20260204 08:59:08.902774 18439 rpcz_store.cc:276] 0204 08:59:07.452443 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.415101 (+962658us) service_pool.cc:225] Handling call
0204 08:59:08.481222 (+ 66121us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd41b541 00007fcebd3f87d3 00007fcebd3a74c9 00007fceb6837bf4 00007fceb6837b82 00007fceb6837ab1
0204 08:59:08.481347 (+ 125us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.481431 (+ 84us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.638069 (+156638us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.732455 (+ 94386us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.732866 (+ 411us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9626368}
I20260204 08:59:08.856703 18367 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45696 (request call id 43) took 1276 ms. Trace:
I20260204 08:59:08.903944 18367 rpcz_store.cc:276] 0204 08:59:07.495168 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.556813 (+1061645us) service_pool.cc:225] Handling call
0204 08:59:08.558503 (+ 1690us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.558597 (+ 94us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.687449 (+128852us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.771134 (+ 83685us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.771606 (+ 472us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.760453 18506 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 39) took 1209 ms. Trace:
I20260204 08:59:08.789160 18432 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 41) took 1308 ms. Trace:
I20260204 08:59:08.891742 18568 ts_tablet_manager.cc:1403] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.508s user 0.014s sys 0.013s
I20260204 08:59:08.903129 18291 rpcz_store.cc:276] 0204 08:59:07.477486 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.402875 (+925389us) service_pool.cc:225] Handling call
0204 08:59:08.432951 (+ 30076us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.433035 (+ 84us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.620890 (+187855us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.804017 (+183127us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.804547 (+ 530us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.904726 18432 rpcz_store.cc:276] 0204 08:59:07.480449 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.484043 (+1003594us) service_pool.cc:225] Handling call
0204 08:59:08.485621 (+ 1578us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.485703 (+ 82us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.658370 (+172667us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.788612 (+130242us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.789091 (+ 479us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.896701 18567 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:08.888401 18359 rpcz_store.cc:276] 0204 08:59:07.478692 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.353716 (+875024us) service_pool.cc:225] Handling call
0204 08:59:08.355438 (+ 1722us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.355527 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.582901 (+227374us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.662446 (+ 79545us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.675801 (+ 13355us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.904654 18506 rpcz_store.cc:276] 0204 08:59:07.551031 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.378147 (+827116us) service_pool.cc:225] Handling call
0204 08:59:08.449109 (+ 70962us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.449200 (+ 91us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.617209 (+168009us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.695537 (+ 78328us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.760389 (+ 64852us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 08:59:08.896024 18340 leader_election.cc:343] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.889945 18363 rpcz_store.cc:276] 0204 08:59:07.472152 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.255138 (+782986us) service_pool.cc:225] Handling call
0204 08:59:08.354200 (+ 99062us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.354287 (+ 87us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.561532 (+207245us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.702993 (+141461us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.703427 (+ 434us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.888115 18436 rpcz_store.cc:276] 0204 08:59:07.411894 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.374646 (+962752us) service_pool.cc:225] Handling call
0204 08:59:08.476919 (+102273us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.477043 (+ 124us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.631314 (+154271us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.696520 (+ 65206us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.696914 (+ 394us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.748623 18511 rpcz_store.cc:276] 0204 08:59:07.491541 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.240081 (+748540us) service_pool.cc:225] Handling call
0204 08:59:08.241845 (+ 1764us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.241934 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.589536 (+347602us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.627475 (+ 37939us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.667626 (+ 40151us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.672355 18286 rpcz_store.cc:276] 0204 08:59:07.477134 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.355791 (+878657us) service_pool.cc:225] Handling call
0204 08:59:08.357417 (+ 1626us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.357504 (+ 87us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.577036 (+219532us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.643598 (+ 66562us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.655232 (+ 11634us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.908581 18510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2817d87504042fba8cda4e4e352c571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.675006 18513 rpcz_store.cc:276] 0204 08:59:07.550684 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.401836 (+851152us) service_pool.cc:225] Handling call
0204 08:59:08.446101 (+ 44265us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.446195 (+ 94us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.596842 (+150647us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.653254 (+ 56412us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.664821 (+ 11567us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.674043 18365 rpcz_store.cc:276] 0204 08:59:07.472719 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.341592 (+868873us) service_pool.cc:225] Handling call
0204 08:59:08.449336 (+107744us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.449418 (+ 82us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.614253 (+164835us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.661878 (+ 47625us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.664625 (+ 2747us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.883464 18285 rpcz_store.cc:276] 0204 08:59:07.503287 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.501713 (+998426us) service_pool.cc:225] Handling call
0204 08:59:08.519487 (+ 17774us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.519586 (+ 99us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.657411 (+137825us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.732067 (+ 74656us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.732512 (+ 445us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 08:59:08.908906 18340 leader_election.cc:343] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.674710 18509 rpcz_store.cc:276] 0204 08:59:07.488882 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:07.873731 (+384849us) service_pool.cc:225] Handling call
0204 08:59:07.875535 (+ 1804us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:07.875627 (+ 92us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.467671 (+592044us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.634911 (+167240us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.635391 (+ 480us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.888203 18437 rpcz_store.cc:276] 0204 08:59:07.486886 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.519605 (+1032719us) service_pool.cc:225] Handling call
0204 08:59:08.521521 (+ 1916us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.521622 (+ 101us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.677430 (+155808us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.692621 (+ 15191us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.692997 (+ 376us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.908944 18570 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:08.751168 18358 rpcz_store.cc:276] 0204 08:59:07.484980 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.441057 (+956077us) service_pool.cc:225] Handling call
0204 08:59:08.442665 (+ 1608us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.442758 (+ 93us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.617242 (+174484us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.655528 (+ 38286us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.673378 (+ 17850us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.907122 18515 rpcz_store.cc:276] 0204 08:59:07.551315 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.639365 (+1088050us) service_pool.cc:225] Handling call
0204 08:59:08.641041 (+ 1676us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.641134 (+ 93us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.696478 (+ 55344us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.725455 (+ 28977us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.725895 (+ 440us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 08:59:08.900544 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 233701us
I20260204 08:59:08.918927 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72802a089d72492ca11d2d83ae08413c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 08:59:08.890728 18508 rpcz_store.cc:276] 0204 08:59:07.552255 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.480544 (+928289us) service_pool.cc:225] Handling call
0204 08:59:08.500343 (+ 19799us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.500445 (+ 102us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.661719 (+161274us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.690821 (+ 29102us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.691249 (+ 428us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.891687 18362 rpcz_store.cc:276] 0204 08:59:07.479053 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.436410 (+957357us) service_pool.cc:225] Handling call
0204 08:59:08.438004 (+ 1594us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.438100 (+ 96us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.637801 (+199701us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.694678 (+ 56877us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.695078 (+ 400us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.917022 18340 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:08.917343 18289 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43854 (request call id 43) took 1425 ms. Trace:
I20260204 08:59:08.923861 18289 rpcz_store.cc:276] 0204 08:59:07.492142 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.445924 (+953782us) service_pool.cc:225] Handling call
0204 08:59:08.447600 (+ 1676us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.447713 (+ 113us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.583638 (+135925us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.898949 (+315311us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.916220 (+ 17271us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.888310 18364 rpcz_store.cc:276] 0204 08:59:07.472442 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.323528 (+851086us) service_pool.cc:225] Handling call
0204 08:59:08.325244 (+ 1716us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.325330 (+ 86us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.596837 (+271507us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.680120 (+ 83283us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.680496 (+ 376us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.924831 18575 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:08.921408 18569 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:08.895465 18361 rpcz_store.cc:276] 0204 08:59:07.471453 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.137959 (+666506us) service_pool.cc:225] Handling call
0204 08:59:08.312496 (+174537us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b5800035798. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb53043e2 00007fcebe1e0189 00007fcebd336108 00007fcebd3f8890 00007fcebd3a74c9 00007fceb6837bf4 00007fceb6837b82 00007fceb6837ab1 00007fceb6837a2c
0204 08:59:08.312567 (+ 71us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.312665 (+ 98us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.558802 (+246137us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.700456 (+141654us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.700866 (+ 410us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":51551104}
I20260204 08:59:08.896505 18287 rpcz_store.cc:276] 0204 08:59:07.483610 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.439895 (+956285us) service_pool.cc:225] Handling call
0204 08:59:08.441462 (+ 1567us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.441554 (+ 92us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.613544 (+171990us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.717228 (+103684us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.717715 (+ 487us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.882958 18440 rpcz_store.cc:276] 0204 08:59:07.454338 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.467421 (+1013083us) service_pool.cc:225] Handling call
0204 08:59:08.479189 (+ 11768us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.479276 (+ 87us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.652623 (+173347us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.690875 (+ 38252us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.691286 (+ 411us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.931433 18434 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47902 (request call id 43) took 1433 ms. Trace:
I20260204 08:59:08.897197 18433 rpcz_store.cc:276] 0204 08:59:07.477458 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.485424 (+1007966us) service_pool.cc:225] Handling call
0204 08:59:08.486981 (+ 1557us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.487072 (+ 91us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.626261 (+139189us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.695630 (+ 69369us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.696060 (+ 430us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.931921 18434 rpcz_store.cc:276] 0204 08:59:07.497894 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.563242 (+1065348us) service_pool.cc:225] Handling call
0204 08:59:08.673061 (+109819us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.675782 (+ 2721us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.779445 (+103663us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.930962 (+151517us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.931376 (+ 414us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.933709 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:08.935331 18568 raft_consensus.cc:359] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.936105 18568 raft_consensus.cc:385] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.936388 18568 raft_consensus.cc:740] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
W20260204 08:59:08.939792 18417 leader_election.cc:343] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:08.940392 18570 tablet_bootstrap.cc:654] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.940284 18417 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:08.940984 18567 tablet_bootstrap.cc:654] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.941627 18579 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:08.940276 18569 tablet_bootstrap.cc:654] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.937587 18568 consensus_queue.cc:260] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.949091 18568 ts_tablet_manager.cc:1434] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.044s user 0.002s sys 0.003s
I20260204 08:59:08.949733 18569 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:08.950234 18569 ts_tablet_manager.cc:1403] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.001s
I20260204 08:59:08.951256 18567 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:08.951525 18568 tablet_bootstrap.cc:492] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:08.951740 18567 ts_tablet_manager.cc:1403] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.062s user 0.011s sys 0.000s
I20260204 08:59:08.954538 18567 raft_consensus.cc:359] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.955196 18567 raft_consensus.cc:385] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.958046 18568 tablet_bootstrap.cc:654] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.958880 18570 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:08.959347 18570 ts_tablet_manager.cc:1403] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.052s user 0.012s sys 0.003s
I20260204 08:59:08.958009 18514 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 41) took 1406 ms. Trace:
I20260204 08:59:08.960963 18514 rpcz_store.cc:276] 0204 08:59:07.551622 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.643297 (+1091675us) service_pool.cc:225] Handling call
0204 08:59:08.905437 (+262140us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.905524 (+ 87us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.931202 (+ 25678us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.957562 (+ 26360us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.957946 (+ 384us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.962121 18570 raft_consensus.cc:359] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.962841 18570 raft_consensus.cc:385] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.963132 18570 raft_consensus.cc:740] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:08.955480 18567 raft_consensus.cc:740] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:08.963809 18577 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:08.964277 18577 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.964491 18567 consensus_queue.cc:260] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.965238 18510 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60734 (request call id 42) took 1413 ms. Trace:
I20260204 08:59:08.965665 18510 rpcz_store.cc:276] 0204 08:59:07.551961 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:08.676140 (+1124179us) service_pool.cc:225] Handling call
0204 08:59:08.892533 (+216393us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0204 08:59:08.897542 (+ 5009us) ts_tablet_manager.cc:682] Creating new metadata...
0204 08:59:08.952937 (+ 55395us) tablet_metadata.cc:641] Metadata flushed
0204 08:59:08.964755 (+ 11818us) tablet_replica.cc:206] Creating consensus instance
0204 08:59:08.965182 (+ 427us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:08.966390 18577 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:08.963318 18569 raft_consensus.cc:359] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.968302 18569 raft_consensus.cc:385] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.968681 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:08.970752 18567 ts_tablet_manager.cc:1434] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260204 08:59:08.971897 18567 tablet_bootstrap.cc:492] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:08.968632 18569 raft_consensus.cc:740] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:08.974175 18570 consensus_queue.cc:260] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.976444 18570 ts_tablet_manager.cc:1434] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20260204 08:59:08.977365 18570 tablet_bootstrap.cc:492] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:08.977949 18567 tablet_bootstrap.cc:654] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:08.980394 18569 consensus_queue.cc:260] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:08.986016 18302 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:08.987376 18567 tablet_bootstrap.cc:492] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:08.987901 18567 ts_tablet_manager.cc:1403] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20260204 08:59:08.988735 18568 tablet_bootstrap.cc:492] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:08.989053 18491 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:08.989954 18577 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:08.990345 18577 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:08.990916 18577 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:08.993039 18569 ts_tablet_manager.cc:1434] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.042s user 0.005s sys 0.001s
I20260204 08:59:08.993613 18579 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:08.994151 18569 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:08.994117 18579 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:08.996322 18579 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:08.990442 18567 raft_consensus.cc:359] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:08.997323 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:08.997277 18567 raft_consensus.cc:385] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:08.998027 18377 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:08.998301 18567 raft_consensus.cc:740] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:08.999188 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:08.999848 18302 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:08.999930 18567 consensus_queue.cc:260] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.001068 18417 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:09.001780 18570 tablet_bootstrap.cc:654] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.003758 18567 ts_tablet_manager.cc:1434] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260204 08:59:09.004729 18567 tablet_bootstrap.cc:492] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:08.989262 18568 ts_tablet_manager.cc:1403] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.038s user 0.015s sys 0.014s
I20260204 08:59:09.008258 18579 raft_consensus.cc:2804] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.008646 18579 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.008949 18579 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.014071 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:09.015439 18488 leader_election.cc:343] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.015951 18579 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.016288 18569 tablet_bootstrap.cc:654] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.007562 18568 raft_consensus.cc:359] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.017539 18568 raft_consensus.cc:385] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.017859 18568 raft_consensus.cc:740] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.018642 18568 consensus_queue.cc:260] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.019479 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:09.020444 18302 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.016224 18577 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.022689 18570 tablet_bootstrap.cc:492] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:09.023240 18570 ts_tablet_manager.cc:1403] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.046s user 0.012s sys 0.000s
I20260204 08:59:09.026387 18570 raft_consensus.cc:359] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.026461 18567 tablet_bootstrap.cc:654] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.029227 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:09.029786 18570 raft_consensus.cc:385] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.030292 18570 raft_consensus.cc:740] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.030441 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:09.030966 18488 leader_election.cc:343] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.029358 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:09.031181 18570 consensus_queue.cc:260] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.031019 18377 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.028306 18577 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.029155 18579 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:09.031945 18301 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.036222 18567 tablet_bootstrap.cc:492] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.037128 18567 ts_tablet_manager.cc:1403] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.009s
I20260204 08:59:09.040266 18377 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:09.040297 18567 raft_consensus.cc:359] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.041177 18567 raft_consensus.cc:385] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.041468 18567 raft_consensus.cc:740] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.041627 18414 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:09.042474 18570 ts_tablet_manager.cc:1434] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.019s user 0.013s sys 0.001s
I20260204 08:59:09.042145 18567 consensus_queue.cc:260] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.042946 18579 raft_consensus.cc:2804] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.043771 18570 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:09.045064 18568 ts_tablet_manager.cc:1434] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.040s user 0.004s sys 0.002s
I20260204 08:59:09.046342 18568 tablet_bootstrap.cc:492] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:09.048586 18579 raft_consensus.cc:697] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:09.049459 18579 consensus_queue.cc:237] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.054417 18568 tablet_bootstrap.cc:654] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.054526 18570 tablet_bootstrap.cc:654] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.056639 18569 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:09.057067 18569 ts_tablet_manager.cc:1403] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.063s user 0.010s sys 0.001s
I20260204 08:59:09.059186 18569 raft_consensus.cc:359] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.059820 18569 raft_consensus.cc:385] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.060047 18569 raft_consensus.cc:740] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.060757 18570 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:09.060519 18569 consensus_queue.cc:260] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.090131 18302 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:09.096165 18567 ts_tablet_manager.cc:1434] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.059s user 0.010s sys 0.010s
I20260204 08:59:09.098960 18567 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.099505 18569 ts_tablet_manager.cc:1434] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.042s user 0.007s sys 0.000s
I20260204 08:59:09.104096 18575 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.106240 18575 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.114259 18575 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:09.115515 18570 ts_tablet_manager.cc:1403] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.072s user 0.007s sys 0.005s
I20260204 08:59:09.117098 18569 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:09.120311 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.120230 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:09.125869 18340 leader_election.cc:343] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:09.126729 18340 leader_election.cc:343] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.127162 18340 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:09.128033 18569 tablet_bootstrap.cc:654] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.127537 18570 raft_consensus.cc:359] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.128221 18575 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:09.128435 18570 raft_consensus.cc:385] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.128803 18570 raft_consensus.cc:740] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.127122 18567 tablet_bootstrap.cc:654] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.130007 18301 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:09.129976 18570 consensus_queue.cc:260] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.122932 18199 catalog_manager.cc:5654] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:09.132790 18491 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:09.133136 18568 tablet_bootstrap.cc:492] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:09.133899 18568 ts_tablet_manager.cc:1403] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.088s user 0.007s sys 0.008s
I20260204 08:59:09.133929 18613 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.134716 18613 raft_consensus.cc:697] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:09.136023 18613 consensus_queue.cc:237] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.137508 18568 raft_consensus.cc:359] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.138329 18568 raft_consensus.cc:385] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.138607 18568 raft_consensus.cc:740] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.141427 18568 consensus_queue.cc:260] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.142186 18570 ts_tablet_manager.cc:1434] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.025s user 0.008s sys 0.001s
I20260204 08:59:09.143786 18570 tablet_bootstrap.cc:492] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:09.148753 18568 ts_tablet_manager.cc:1434] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.014s user 0.005s sys 0.002s
I20260204 08:59:09.149878 18577 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.150496 18569 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:09.150554 18567 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.150393 18577 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.151042 18569 ts_tablet_manager.cc:1403] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.035s user 0.014s sys 0.002s
I20260204 08:59:09.151379 18567 ts_tablet_manager.cc:1403] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.053s user 0.014s sys 0.005s
I20260204 08:59:09.152746 18577 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.154471 18569 raft_consensus.cc:359] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.154757 18567 raft_consensus.cc:359] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.155683 18567 raft_consensus.cc:385] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.156147 18567 raft_consensus.cc:740] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.157079 18567 consensus_queue.cc:260] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.158057 18568 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:09.155259 18569 raft_consensus.cc:385] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.158855 18569 raft_consensus.cc:740] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.160859 18567 ts_tablet_manager.cc:1434] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260204 08:59:09.160507 18569 consensus_queue.cc:260] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.162382 18567 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.163341 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.164274 18377 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:09.165335 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:09.165788 18568 tablet_bootstrap.cc:654] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.166028 18451 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:09.167896 18488 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:09.169298 18577 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.169656 18577 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.168033 18569 ts_tablet_manager.cc:1434] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.017s user 0.007s sys 0.001s
I20260204 08:59:09.169989 18577 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.170555 18567 tablet_bootstrap.cc:654] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.174613 18569 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:09.192307 18570 tablet_bootstrap.cc:654] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.195243 18577 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.197280 18577 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.216969 18568 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:09.217263 18569 tablet_bootstrap.cc:654] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.217548 18568 ts_tablet_manager.cc:1403] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.060s user 0.013s sys 0.005s
I20260204 08:59:09.220691 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:09.220969 18568 raft_consensus.cc:359] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.221760 18568 raft_consensus.cc:385] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.221684 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:09.222205 18568 raft_consensus.cc:740] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.223160 18568 consensus_queue.cc:260] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.224527 18377 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.225440 18567 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.226069 18567 ts_tablet_manager.cc:1403] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.064s user 0.030s sys 0.030s
I20260204 08:59:09.228468 18200 catalog_manager.cc:5654] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:09.230096 18567 raft_consensus.cc:359] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.230964 18567 raft_consensus.cc:385] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.231180 18451 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.231384 18567 raft_consensus.cc:740] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.232473 18567 consensus_queue.cc:260] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.233307 18568 ts_tablet_manager.cc:1434] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20260204 08:59:09.235543 18567 ts_tablet_manager.cc:1434] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260204 08:59:09.237147 18567 tablet_bootstrap.cc:492] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.241562 18568 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:09.244024 18567 tablet_bootstrap.cc:654] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.244943 18377 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:09.246107 18488 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:09.247002 18577 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.247849 18577 raft_consensus.cc:697] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:09.247882 18451 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:09.249017 18577 consensus_queue.cc:237] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.251410 18570 tablet_bootstrap.cc:492] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:09.251974 18570 ts_tablet_manager.cc:1403] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.109s user 0.012s sys 0.003s
I20260204 08:59:09.248968 18568 tablet_bootstrap.cc:654] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.254273 18575 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.254733 18575 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.256855 18575 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.257766 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.258363 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.258664 18525 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
W20260204 08:59:09.260275 18343 leader_election.cc:343] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.260977 18340 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:09.262179 18575 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.262591 18575 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.262959 18575 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.272704 18570 raft_consensus.cc:359] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.273532 18570 raft_consensus.cc:385] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.273873 18570 raft_consensus.cc:740] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.275256 18570 consensus_queue.cc:260] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.277482 18568 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:09.277823 18570 ts_tablet_manager.cc:1434] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20260204 08:59:09.278235 18568 ts_tablet_manager.cc:1403] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.010s
I20260204 08:59:09.279567 18570 tablet_bootstrap.cc:492] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:09.280598 18567 tablet_bootstrap.cc:492] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.281091 18567 ts_tablet_manager.cc:1403] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.044s user 0.012s sys 0.011s
I20260204 08:59:09.281279 18575 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.284086 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:09.284678 18525 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.283882 18567 raft_consensus.cc:359] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.287361 18567 raft_consensus.cc:385] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.287740 18567 raft_consensus.cc:740] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.288268 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:09.288545 18567 consensus_queue.cc:260] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:09.290390 18343 leader_election.cc:343] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.292047 18568 raft_consensus.cc:359] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.292732 18568 raft_consensus.cc:385] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.293016 18568 raft_consensus.cc:740] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.294129 18525 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:09.289562 18575 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.295298 18575 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.295560 18340 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:09.297348 18569 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:09.293825 18568 consensus_queue.cc:260] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.297694 18567 ts_tablet_manager.cc:1434] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20260204 08:59:09.298580 18579 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.298776 18575 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.299355 18579 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.301064 18575 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.301990 18579 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.302434 18567 tablet_bootstrap.cc:492] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.303143 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.303712 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.304356 18634 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.297842 18569 ts_tablet_manager.cc:1403] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.124s user 0.026s sys 0.020s
I20260204 08:59:09.304378 18301 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:09.308264 18417 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:09.307580 18569 raft_consensus.cc:359] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.307756 18634 raft_consensus.cc:697] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:09.310472 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.310372 18634 consensus_queue.cc:237] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.311259 18579 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.311619 18579 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.309340 18569 raft_consensus.cc:385] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.318570 18569 raft_consensus.cc:740] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.320290 18567 tablet_bootstrap.cc:654] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.320717 18569 consensus_queue.cc:260] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.311976 18579 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:09.318495 18343 leader_election.cc:343] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.303754 18525 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:09.330621 18340 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:09.331332 18568 ts_tablet_manager.cc:1434] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.052s user 0.004s sys 0.019s
I20260204 08:59:09.332609 18568 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:09.333721 18570 tablet_bootstrap.cc:654] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.334615 18575 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.335013 18575 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.335330 18575 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.337628 18569 ts_tablet_manager.cc:1434] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.033s user 0.006s sys 0.001s
I20260204 08:59:09.339623 18199 catalog_manager.cc:5654] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:09.339634 18569 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:09.342958 18615 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.343436 18615 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.345507 18615 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.348435 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:09.349829 18417 leader_election.cc:343] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.352993 18568 tablet_bootstrap.cc:654] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.356447 18579 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.359440 18579 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.360958 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:09.361541 18301 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.363672 18575 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.378624 18301 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:09.379750 18417 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:09.380262 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:09.363479 18569 tablet_bootstrap.cc:654] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.380916 18525 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.365885 18567 tablet_bootstrap.cc:492] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.383837 18567 ts_tablet_manager.cc:1403] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.082s user 0.009s sys 0.009s
I20260204 08:59:09.380621 18579 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.384817 18579 raft_consensus.cc:697] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:09.386374 18579 consensus_queue.cc:237] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.387404 18575 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.388603 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:09.390337 18343 leader_election.cc:343] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.394572 18577 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.395200 18577 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.397388 18577 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.398584 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.398862 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:09.399276 18302 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
W20260204 08:59:09.404119 18488 leader_election.cc:343] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.406607 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.407204 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.407829 18615 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:09.408372 18414 leader_election.cc:343] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.408710 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:09.409343 18491 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:09.406919 18198 catalog_manager.cc:5654] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:09.408381 18615 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.413777 18615 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:09.414361 18577 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.414808 18577 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.415196 18577 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.416440 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.416613 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.417294 18377 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
W20260204 08:59:09.418031 18414 leader_election.cc:343] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.418546 18414 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:09.419536 18615 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260204 08:59:09.420958 18414 leader_election.cc:343] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:09.421953 18414 leader_election.cc:343] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.422806 18414 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:09.426386 18567 raft_consensus.cc:359] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.427263 18567 raft_consensus.cc:385] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.427480 18567 raft_consensus.cc:740] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.426770 18615 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.428297 18615 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.428617 18615 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.430099 18568 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:09.430603 18568 ts_tablet_manager.cc:1403] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.098s user 0.018s sys 0.012s
I20260204 08:59:09.433203 18568 raft_consensus.cc:359] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.433815 18568 raft_consensus.cc:385] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.434077 18568 raft_consensus.cc:740] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.434674 18568 consensus_queue.cc:260] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.426154 18525 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:09.437024 18340 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:09.438102 18634 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.438534 18634 raft_consensus.cc:697] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:09.438699 18577 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.439467 18634 consensus_queue.cc:237] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.441633 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:09.441732 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:09.442479 18302 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:09.443243 18488 leader_election.cc:343] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.444020 18567 consensus_queue.cc:260] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.445164 18577 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.454999 18570 tablet_bootstrap.cc:492] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:09.455808 18568 ts_tablet_manager.cc:1434] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.025s user 0.009s sys 0.000s
I20260204 08:59:09.456197 18570 ts_tablet_manager.cc:1403] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.177s user 0.016s sys 0.026s
I20260204 08:59:09.451972 18615 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.457597 18302 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:09.458596 18615 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:09.458739 18491 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:09.459192 18570 raft_consensus.cc:359] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.459911 18570 raft_consensus.cc:385] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.460183 18613 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.460201 18570 raft_consensus.cc:740] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.460909 18568 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:09.461211 18570 consensus_queue.cc:260] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.461859 18569 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:09.462981 18569 ts_tablet_manager.cc:1403] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.124s user 0.027s sys 0.022s
I20260204 08:59:09.463301 18197 catalog_manager.cc:5654] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:09.464864 18198 catalog_manager.cc:5654] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:09.466348 18569 raft_consensus.cc:359] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.467041 18569 raft_consensus.cc:385] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.467334 18569 raft_consensus.cc:740] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.468722 18568 tablet_bootstrap.cc:654] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.469467 18648 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.470005 18648 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.472915 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:09.473100 18577 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.473508 18377 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.473549 18577 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.460134 18567 ts_tablet_manager.cc:1434] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.076s user 0.006s sys 0.000s
I20260204 08:59:09.479240 18567 tablet_bootstrap.cc:492] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.480243 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.481706 18377 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:09.484625 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:09.485245 18525 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.486300 18616 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.486764 18616 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:09.489076 18248 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:59:09.490075 18616 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:09.491693 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.492559 18525 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:09.492915 18414 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:09.493909 18417 leader_election.cc:343] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.483916 18569 consensus_queue.cc:260] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.494558 18616 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.495010 18616 raft_consensus.cc:697] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:09.495849 18616 consensus_queue.cc:237] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.500015 18570 ts_tablet_manager.cc:1434] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.043s user 0.009s sys 0.001s
I20260204 08:59:09.501243 18570 tablet_bootstrap.cc:492] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:09.496877 18579 consensus_queue.cc:1048] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260204 08:59:09.503929 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.504246 18568 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:09.504757 18568 ts_tablet_manager.cc:1403] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.045s user 0.022s sys 0.007s
I20260204 08:59:09.505735 18648 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.507143 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:09.507882 18451 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:09.508389 18577 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.509105 18613 raft_consensus.cc:697] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:09.509717 18488 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:09.510614 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:09.510759 18568 raft_consensus.cc:359] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.510093 18613 consensus_queue.cc:237] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.511478 18568 raft_consensus.cc:385] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.511811 18568 raft_consensus.cc:740] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.507547 18569 ts_tablet_manager.cc:1434] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260204 08:59:09.512460 18488 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:09.512571 18568 consensus_queue.cc:260] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:09.507121 18414 leader_election.cc:343] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.513841 18569 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:09.514048 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.513751 18414 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:09.514756 18377 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:09.515587 18616 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:09.517208 18646 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.517594 18646 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.517764 18634 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.517946 18646 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.518255 18634 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.519543 18567 tablet_bootstrap.cc:654] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.520146 18634 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.522454 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.521385 18577 raft_consensus.cc:2749] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:09.524753 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:09.525823 18343 leader_election.cc:343] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:09.526839 18340 leader_election.cc:343] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.527293 18340 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:09.528301 18634 raft_consensus.cc:2749] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:09.526203 18197 catalog_manager.cc:5654] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:09.528949 18570 tablet_bootstrap.cc:654] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.529309 18646 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.534282 18568 ts_tablet_manager.cc:1434] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260204 08:59:09.541263 18568 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:09.547616 18568 tablet_bootstrap.cc:654] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.551954 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:09.552565 18377 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.553022 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:09.553580 18451 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.554225 18646 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.553121 18200 catalog_manager.cc:5654] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:09.559585 18600 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.563519 18451 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:09.564330 18600 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.565819 18567 tablet_bootstrap.cc:492] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.566332 18567 ts_tablet_manager.cc:1403] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.087s user 0.015s sys 0.000s
I20260204 08:59:09.566946 18600 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:09.568910 18567 raft_consensus.cc:359] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.569648 18567 raft_consensus.cc:385] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.569901 18567 raft_consensus.cc:740] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.570477 18567 consensus_queue.cc:260] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.568868 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.572575 18567 ts_tablet_manager.cc:1434] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260204 08:59:09.573676 18567 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.575088 18569 tablet_bootstrap.cc:654] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.576340 18579 consensus_queue.cc:1048] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:09.581852 18567 tablet_bootstrap.cc:654] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.587183 18488 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:09.588037 18646 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.588493 18646 raft_consensus.cc:697] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:09.588665 18600 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.589306 18600 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.585778 18377 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:09.589300 18646 consensus_queue.cc:237] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:09.595882 18265 leader_election.cc:343] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.591683 18600 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.604979 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:09.606475 18265 leader_election.cc:343] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.610239 18570 tablet_bootstrap.cc:492] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:09.610760 18570 ts_tablet_manager.cc:1403] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.110s user 0.018s sys 0.009s
I20260204 08:59:09.615381 18570 raft_consensus.cc:359] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.616055 18570 raft_consensus.cc:385] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.616302 18570 raft_consensus.cc:740] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.616916 18570 consensus_queue.cc:260] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.618933 18570 ts_tablet_manager.cc:1434] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260204 08:59:09.620296 18570 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:09.624899 18568 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:09.625555 18568 ts_tablet_manager.cc:1403] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.085s user 0.007s sys 0.012s
I20260204 08:59:09.625658 18634 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.626235 18634 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.608412 18613 consensus_queue.cc:1048] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260204 08:59:09.628111 18568 raft_consensus.cc:359] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.628726 18568 raft_consensus.cc:385] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.628994 18568 raft_consensus.cc:740] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.629774 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.630430 18377 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:09.626368 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.633642 18265 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:09.634366 18634 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.634485 18600 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.634944 18600 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.635325 18600 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.635598 18568 consensus_queue.cc:260] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.634843 18567 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.636648 18567 ts_tablet_manager.cc:1403] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.063s user 0.021s sys 0.027s
I20260204 08:59:09.638312 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.638604 18570 tablet_bootstrap.cc:654] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
W20260204 08:59:09.640698 18343 leader_election.cc:343] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.640357 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:09.641870 18451 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:09.643123 18340 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:09.643895 18575 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.640446 18568 ts_tablet_manager.cc:1434] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.015s user 0.002s sys 0.004s
I20260204 08:59:09.641188 18375 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:09.644265 18575 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.644851 18575 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.639086 18567 raft_consensus.cc:359] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.646117 18265 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:09.646341 18567 raft_consensus.cc:385] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.646711 18567 raft_consensus.cc:740] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.647346 18662 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.647456 18567 consensus_queue.cc:260] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.648032 18662 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.648389 18662 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.649920 18567 ts_tablet_manager.cc:1434] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260204 08:59:09.651237 18568 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:09.656553 18662 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.659210 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:09.659749 18375 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.661119 18648 consensus_queue.cc:1048] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:09.666913 18375 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:09.667824 18575 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.668167 18265 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:09.670737 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:09.671847 18575 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:09.672271 18343 leader_election.cc:343] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.674233 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:09.674492 18662 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.674947 18450 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.677673 18671 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.678226 18671 raft_consensus.cc:697] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:09.681201 18662 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.681685 18662 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.682266 18449 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.688016 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:09.689436 18568 tablet_bootstrap.cc:654] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.690287 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.690807 18450 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:09.691449 18648 consensus_queue.cc:1048] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:09.691926 18340 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:09.692479 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.692941 18567 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.693303 18525 raft_consensus.cc:2393] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:09.694633 18575 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.694943 18265 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:09.695314 18575 raft_consensus.cc:697] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 08:59:09.695883 18265 leader_election.cc:343] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.696231 18575 consensus_queue.cc:237] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.697077 18670 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.698909 18567 tablet_bootstrap.cc:654] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.700821 18569 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:09.701267 18569 ts_tablet_manager.cc:1403] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.188s user 0.009s sys 0.013s
I20260204 08:59:09.679075 18671 consensus_queue.cc:237] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.683481 18662 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:09.703622 18569 raft_consensus.cc:359] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.719063 18569 raft_consensus.cc:385] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.719342 18569 raft_consensus.cc:740] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.713907 18670 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:09.722349 18568 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:09.722837 18568 ts_tablet_manager.cc:1403] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.072s user 0.007s sys 0.003s
I20260204 08:59:09.705278 18600 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.725844 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:09.726361 18600 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:09.725999 18197 catalog_manager.cc:5654] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
W20260204 08:59:09.727577 18265 leader_election.cc:343] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.728420 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:09.728991 18376 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.729409 18569 consensus_queue.cc:260] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.731422 18569 ts_tablet_manager.cc:1434] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.030s user 0.003s sys 0.003s
I20260204 08:59:09.745575 18569 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:09.745270 18568 raft_consensus.cc:359] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.745972 18568 raft_consensus.cc:385] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.746240 18568 raft_consensus.cc:740] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.746893 18568 consensus_queue.cc:260] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.748835 18568 ts_tablet_manager.cc:1434] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.026s user 0.003s sys 0.002s
I20260204 08:59:09.766755 18568 tablet_bootstrap.cc:492] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:09.775607 18376 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:09.777771 18569 tablet_bootstrap.cc:654] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.780046 18265 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:09.780349 18198 catalog_manager.cc:5654] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:09.780975 18671 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.781543 18671 raft_consensus.cc:697] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:09.782320 18671 consensus_queue.cc:237] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.787390 18567 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.787878 18567 ts_tablet_manager.cc:1403] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.137s user 0.011s sys 0.011s
I20260204 08:59:09.788337 18570 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:09.788774 18570 ts_tablet_manager.cc:1403] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.169s user 0.027s sys 0.026s
W20260204 08:59:09.793434 18343 consensus_peers.cc:597] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:09.792909 18197 catalog_manager.cc:5654] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:09.794211 18568 tablet_bootstrap.cc:654] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.792909 18646 consensus_queue.cc:1048] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260204 08:59:09.799695 18567 raft_consensus.cc:359] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.804082 18567 raft_consensus.cc:385] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.804428 18567 raft_consensus.cc:740] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.805111 18567 consensus_queue.cc:260] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.806305 18569 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:09.806762 18569 ts_tablet_manager.cc:1403] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.002s
I20260204 08:59:09.807765 18567 ts_tablet_manager.cc:1434] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260204 08:59:09.800021 18570 raft_consensus.cc:359] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.808346 18570 raft_consensus.cc:385] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.808668 18570 raft_consensus.cc:740] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.809386 18570 consensus_queue.cc:260] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.811728 18570 ts_tablet_manager.cc:1434] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20260204 08:59:09.813853 18570 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:09.813501 18200 catalog_manager.cc:5654] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:09.816893 18567 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.809224 18569 raft_consensus.cc:359] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.817787 18569 raft_consensus.cc:385] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.818063 18569 raft_consensus.cc:740] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.818782 18569 consensus_queue.cc:260] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.821097 18569 ts_tablet_manager.cc:1434] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260204 08:59:09.822033 18569 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
W20260204 08:59:09.826588 18414 consensus_peers.cc:597] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 -> Peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Couldn't send request to peer 5bc1d8b58ce0457da263c5c017c92ca4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:09.827355 18569 tablet_bootstrap.cc:654] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.833763 18570 tablet_bootstrap.cc:654] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.836278 18568 tablet_bootstrap.cc:492] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:09.836730 18568 ts_tablet_manager.cc:1403] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.087s user 0.023s sys 0.015s
I20260204 08:59:09.841383 18567 tablet_bootstrap.cc:654] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.846683 18568 raft_consensus.cc:359] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.847409 18568 raft_consensus.cc:385] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.847692 18568 raft_consensus.cc:740] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.850040 18567 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:09.850555 18567 ts_tablet_manager.cc:1403] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.007s
I20260204 08:59:09.852397 18568 consensus_queue.cc:260] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.854748 18568 ts_tablet_manager.cc:1434] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260204 08:59:09.852501 18671 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.856581 18671 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.858800 18671 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.859251 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.859438 18579 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.859956 18579 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.860250 18376 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:09.860744 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:09.861554 18265 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:09.861837 18579 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:09.862793 18265 leader_election.cc:343] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.863032 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.863798 18302 raft_consensus.cc:2393] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 1: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:09.863953 18671 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:09.864334 18671 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:09.864641 18671 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.864981 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.865447 18575 consensus_queue.cc:1048] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:09.866076 18567 raft_consensus.cc:359] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.866722 18567 raft_consensus.cc:385] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.866992 18567 raft_consensus.cc:740] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.867491 18417 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:09.868733 18579 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.870926 18569 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:09.871388 18569 ts_tablet_manager.cc:1403] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.050s user 0.013s sys 0.017s
I20260204 08:59:09.873901 18569 raft_consensus.cc:359] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.874490 18569 raft_consensus.cc:385] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.874481 18671 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.874990 18569 raft_consensus.cc:740] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.875792 18569 consensus_queue.cc:260] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.877897 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:09.878813 18568 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
W20260204 08:59:09.879153 18265 leader_election.cc:343] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.879731 18671 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:09.876792 18579 raft_consensus.cc:2749] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:09.867597 18567 consensus_queue.cc:260] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.877221 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:09.883406 18376 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:09.883803 18575 consensus_queue.cc:1048] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:09.890136 18570 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:09.890653 18570 ts_tablet_manager.cc:1403] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.077s user 0.018s sys 0.023s
I20260204 08:59:09.891364 18376 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:09.892391 18265 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:09.893059 18671 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:09.894387 18671 raft_consensus.cc:697] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:09.893081 18570 raft_consensus.cc:359] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.895162 18570 raft_consensus.cc:385] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.895432 18570 raft_consensus.cc:740] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:09.895756 18567 ts_tablet_manager.cc:1434] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.045s user 0.007s sys 0.001s
I20260204 08:59:09.896662 18568 tablet_bootstrap.cc:654] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.897331 18569 ts_tablet_manager.cc:1434] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.026s user 0.008s sys 0.000s
I20260204 08:59:09.898334 18569 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:09.896744 18567 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:09.904578 18671 consensus_queue.cc:237] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.907634 18646 consensus_queue.cc:1048] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:09.910383 18567 tablet_bootstrap.cc:654] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.913582 18579 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.914144 18579 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.915361 18569 tablet_bootstrap.cc:654] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:09.918818 18615 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.919348 18615 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:09.923038 18615 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:09.921499 18570 consensus_queue.cc:260] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.946179 18668 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.946776 18668 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:09.948869 18668 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:09.950796 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.951409 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.952083 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:09.952761 18525 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:09.944108 18615 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.955452 18265 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:09.955955 18615 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:09.956728 18668 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:09.958005 18615 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:09.959718 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.955185 18414 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:09.945019 18646 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:09.965032 18569 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:09.965430 18569 ts_tablet_manager.cc:1403] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.067s user 0.013s sys 0.009s
I20260204 08:59:09.970325 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.970867 18569 raft_consensus.cc:359] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.963595 18646 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.973913 18646 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:09.975499 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:09.977629 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:09.978487 18301 raft_consensus.cc:2393] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:09.971505 18569 raft_consensus.cc:385] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:09.991281 18569 raft_consensus.cc:740] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
W20260204 08:59:09.978993 18414 leader_election.cc:343] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:09.993995 18491 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:09.994462 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.979122 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:09.997476 18376 raft_consensus.cc:2393] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 1: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:09.994282 18569 consensus_queue.cc:260] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:09.995693 18570 ts_tablet_manager.cc:1434] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.105s user 0.007s sys 0.000s
I20260204 08:59:09.996368 18579 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:09.999969 18570 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:09.998170 18375 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:09.965206 18615 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.002727 18615 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.005540 18567 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:10.007424 18567 ts_tablet_manager.cc:1403] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.111s user 0.031s sys 0.033s
I20260204 08:59:10.007856 18569 ts_tablet_manager.cc:1434] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.042s user 0.007s sys 0.005s
I20260204 08:59:10.004159 18646 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.003636 18648 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.009155 18615 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.012403 18646 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.029314 18198 catalog_manager.cc:5654] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:10.031139 18646 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:10.030759 18577 consensus_queue.cc:1048] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:10.031833 18668 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.032164 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:10.032547 18668 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.034461 18668 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:10.032804 18375 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:10.035127 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:10.035821 18488 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:10.037261 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.037577 18613 raft_consensus.cc:2804] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.037828 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:10.038012 18448 raft_consensus.cc:2468] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:10.038365 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:10.038019 18613 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.039270 18613 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:10.044816 18265 leader_election.cc:343] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.045698 18265 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:10.039340 18491 leader_election.cc:343] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.047477 18668 raft_consensus.cc:2804] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.047871 18668 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.048216 18668 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.051347 18613 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.054937 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:10.056834 18569 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:10.063005 18613 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:10.068679 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:10.069401 18375 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:10.060658 18491 leader_election.cc:343] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.088004 18569 tablet_bootstrap.cc:654] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.089068 18648 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.090947 18375 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:10.092244 18488 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:10.094503 18699 raft_consensus.cc:2804] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:10.095016 18699 raft_consensus.cc:697] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:10.095829 18699 consensus_queue.cc:237] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.097308 18567 raft_consensus.cc:359] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.094498 18668 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.098111 18567 raft_consensus.cc:385] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.100210 18567 raft_consensus.cc:740] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.100862 18567 consensus_queue.cc:260] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.101992 18570 tablet_bootstrap.cc:654] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.102442 18414 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:10.104683 18697 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.104990 18414 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:10.105226 18568 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:10.105616 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:10.105777 18616 raft_consensus.cc:2804] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.106163 18616 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.106215 18448 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.106549 18616 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.108451 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
W20260204 08:59:10.109669 18265 leader_election.cc:343] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.115442 18698 consensus_queue.cc:1048] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:10.116714 18671 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.117210 18671 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.118697 18448 raft_consensus.cc:2468] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:10.119048 18671 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:10.119287 18695 consensus_queue.cc:1048] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260204 08:59:10.119989 18697 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.122237 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.123076 18449 raft_consensus.cc:2393] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:10.122992 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:10.099665 18668 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:10.121640 18616 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.125703 18616 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:10.123090 18568 ts_tablet_manager.cc:1403] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.244s user 0.021s sys 0.035s
I20260204 08:59:10.125608 18648 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.127978 18567 ts_tablet_manager.cc:1434] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.120s user 0.003s sys 0.003s
I20260204 08:59:10.131181 18567 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:10.133843 18615 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.134380 18265 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:10.142392 18668 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.143361 18265 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:10.144279 18671 raft_consensus.cc:2804] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:10.144783 18671 raft_consensus.cc:697] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:10.145627 18671 consensus_queue.cc:237] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.148550 18615 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:10.150238 18668 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.150453 18568 raft_consensus.cc:359] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.151229 18568 raft_consensus.cc:385] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.151477 18568 raft_consensus.cc:740] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.152163 18568 consensus_queue.cc:260] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:10.131182 18414 leader_election.cc:343] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.160887 18568 ts_tablet_manager.cc:1434] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260204 08:59:10.169391 18567 tablet_bootstrap.cc:654] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.170837 18616 consensus_queue.cc:1048] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.172086 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:10.172744 18376 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.180409 18376 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:10.182124 18568 tablet_bootstrap.cc:492] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:10.184885 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:10.185628 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:10.187619 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:10.188210 18522 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.190351 18414 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:10.191234 18616 consensus_queue.cc:1048] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.201961 18616 raft_consensus.cc:2804] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:10.204886 18616 raft_consensus.cc:697] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 08:59:10.205507 18414 leader_election.cc:343] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.209932 18570 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:10.210616 18646 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.210597 18570 ts_tablet_manager.cc:1403] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.211s user 0.014s sys 0.001s
I20260204 08:59:10.215284 18570 raft_consensus.cc:359] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.215927 18570 raft_consensus.cc:385] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.216200 18570 raft_consensus.cc:740] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.218508 18569 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:10.208818 18616 consensus_queue.cc:237] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.221957 18569 ts_tablet_manager.cc:1403] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.204s user 0.026s sys 0.032s
I20260204 08:59:10.218853 18570 consensus_queue.cc:260] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.218595 18522 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:10.234436 18569 raft_consensus.cc:359] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:10.243127 18414 leader_election.cc:343] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.250854 18569 raft_consensus.cc:385] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.235138 18199 catalog_manager.cc:5654] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:10.251171 18569 raft_consensus.cc:740] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.252163 18569 consensus_queue.cc:260] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.246831 18568 tablet_bootstrap.cc:654] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.254283 18569 ts_tablet_manager.cc:1434] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260204 08:59:10.255208 18569 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:10.261497 18414 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:10.267745 18616 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:10.268535 18616 raft_consensus.cc:697] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:10.269425 18616 consensus_queue.cc:237] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.270956 18671 consensus_queue.cc:1048] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.277232 18695 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.277729 18695 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.278156 18569 tablet_bootstrap.cc:654] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.281590 18570 ts_tablet_manager.cc:1434] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260204 08:59:10.283228 18197 catalog_manager.cc:5654] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:10.289232 18567 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:10.289709 18567 ts_tablet_manager.cc:1403] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.159s user 0.029s sys 0.009s
I20260204 08:59:10.296768 18570 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:10.298550 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.299197 18451 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:10.300971 18340 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:10.301714 18634 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.302106 18634 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.302426 18634 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.303805 18671 consensus_queue.cc:1048] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.287849 18695 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:10.306336 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:10.309216 18343 leader_election.cc:343] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.314776 18671 consensus_queue.cc:1048] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.310151 18695 consensus_queue.cc:1048] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260204 08:59:10.325258 18570 tablet_bootstrap.cc:654] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.345958 18568 tablet_bootstrap.cc:492] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:10.346534 18568 ts_tablet_manager.cc:1403] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.165s user 0.028s sys 0.009s
I20260204 08:59:10.349926 18615 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.350499 18615 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.352437 18615 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:10.353174 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:10.355293 18417 leader_election.cc:343] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.354784 18199 catalog_manager.cc:5654] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:10.357782 18525 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.359309 18567 raft_consensus.cc:359] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.360042 18567 raft_consensus.cc:385] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.360357 18567 raft_consensus.cc:740] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.361374 18567 consensus_queue.cc:260] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.362321 18575 consensus_queue.cc:1048] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.363538 18671 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.364001 18671 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.365772 18671 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:10.368162 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.368377 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:10.369547 18265 leader_election.cc:343] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:10.370162 18265 leader_election.cc:343] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.370888 18265 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:10.371636 18668 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.373849 18567 ts_tablet_manager.cc:1434] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.084s user 0.007s sys 0.000s
I20260204 08:59:10.370371 18634 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.377199 18568 raft_consensus.cc:359] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.377911 18568 raft_consensus.cc:385] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.378150 18568 raft_consensus.cc:740] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.378341 18634 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:10.378698 18568 consensus_queue.cc:260] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.379531 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:10.380115 18449 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.380398 18568 ts_tablet_manager.cc:1434] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.034s user 0.005s sys 0.000s
I20260204 08:59:10.383705 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:10.385466 18343 leader_election.cc:343] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.390869 18568 tablet_bootstrap.cc:492] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:10.392839 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:10.395493 18567 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
W20260204 08:59:10.407356 18414 leader_election.cc:343] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.407928 18414 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:10.412154 18300 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.417472 18697 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.421326 18449 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:10.427228 18340 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:10.428416 18634 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:10.429280 18634 raft_consensus.cc:697] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:10.433297 18634 consensus_queue.cc:237] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.440531 18568 tablet_bootstrap.cc:654] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.470852 18570 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:10.471215 18570 ts_tablet_manager.cc:1403] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.176s user 0.021s sys 0.007s
I20260204 08:59:10.474625 18569 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:10.475158 18569 ts_tablet_manager.cc:1403] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.220s user 0.036s sys 0.052s
I20260204 08:59:10.476733 18567 tablet_bootstrap.cc:654] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.476554 18671 consensus_queue.cc:1048] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.488306 18570 raft_consensus.cc:359] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.488951 18570 raft_consensus.cc:385] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.489228 18570 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.493552 18569 raft_consensus.cc:359] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.494272 18569 raft_consensus.cc:385] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.494575 18569 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.494798 18199 catalog_manager.cc:5654] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:10.496690 18570 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.498970 18570 ts_tablet_manager.cc:1434] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20260204 08:59:10.499939 18671 consensus_queue.cc:1048] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.500154 18569 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.514496 18569 ts_tablet_manager.cc:1434] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.039s user 0.002s sys 0.003s
I20260204 08:59:10.515437 18569 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:10.516757 18197 catalog_manager.cc:5654] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:10.522787 18570 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:10.520931 18577 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:10.525059 18577 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.527858 18699 consensus_queue.cc:1048] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.529624 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:10.531279 18570 tablet_bootstrap.cc:654] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.531728 18577 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:10.533468 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:10.535686 18265 consensus_peers.cc:597] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab -> Peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Couldn't send request to peer c61e83e5fb7445e8bce7eca695977903. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:10.538338 18568 tablet_bootstrap.cc:492] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:10.538707 18568 ts_tablet_manager.cc:1403] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.148s user 0.009s sys 0.006s
I20260204 08:59:10.541323 18488 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:10.542505 18699 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:10.542791 18567 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:10.543272 18567 ts_tablet_manager.cc:1403] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.153s user 0.019s sys 0.023s
I20260204 08:59:10.549557 18568 raft_consensus.cc:359] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.550285 18568 raft_consensus.cc:385] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260204 08:59:10.549500 18491 consensus_peers.cc:597] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:10.550557 18568 raft_consensus.cc:740] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
W20260204 08:59:10.544898 18265 consensus_peers.cc:597] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab -> Peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Couldn't send request to peer 5bc1d8b58ce0457da263c5c017c92ca4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:10.551491 18568 consensus_queue.cc:260] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.555547 18568 ts_tablet_manager.cc:1434] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260204 08:59:10.556615 18568 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:10.558179 18569 tablet_bootstrap.cc:654] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.564308 18567 raft_consensus.cc:359] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.565013 18567 raft_consensus.cc:385] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.565294 18567 raft_consensus.cc:740] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.566049 18567 consensus_queue.cc:260] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.568076 18567 ts_tablet_manager.cc:1434] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.025s user 0.007s sys 0.001s
I20260204 08:59:10.569037 18567 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
W20260204 08:59:10.571420 18248 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:59:10.591471 18568 tablet_bootstrap.cc:654] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.594558 18567 tablet_bootstrap.cc:654] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.597361 18570 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:10.597841 18570 ts_tablet_manager.cc:1403] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.078s user 0.016s sys 0.029s
I20260204 08:59:10.600152 18570 raft_consensus.cc:359] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.600785 18570 raft_consensus.cc:385] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.601055 18570 raft_consensus.cc:740] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.601691 18570 consensus_queue.cc:260] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.603608 18570 ts_tablet_manager.cc:1434] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260204 08:59:10.604496 18570 tablet_bootstrap.cc:492] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:10.610234 18570 tablet_bootstrap.cc:654] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.614425 18600 consensus_queue.cc:1048] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.619199 18569 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:10.619764 18569 ts_tablet_manager.cc:1403] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.105s user 0.009s sys 0.011s
I20260204 08:59:10.622293 18569 raft_consensus.cc:359] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.623050 18569 raft_consensus.cc:385] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.623317 18569 raft_consensus.cc:740] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.624070 18569 consensus_queue.cc:260] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.626583 18569 ts_tablet_manager.cc:1434] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260204 08:59:10.627621 18569 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:10.628882 18616 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.629356 18616 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.631210 18616 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:10.632686 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:10.633216 18569 tablet_bootstrap.cc:654] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
W20260204 08:59:10.634027 18414 leader_election.cc:343] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.637655 18616 consensus_queue.cc:1048] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.640232 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:10.641592 18417 leader_election.cc:343] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.642195 18417 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:10.642995 18634 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.643522 18634 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.645375 18634 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:10.647193 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.647842 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:10.648603 18525 raft_consensus.cc:2393] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 1: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:10.650328 18340 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:10.651538 18634 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.653466 18570 tablet_bootstrap.cc:492] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:10.653944 18570 ts_tablet_manager.cc:1403] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.013s
I20260204 08:59:10.654347 18616 raft_consensus.cc:2749] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.656900 18568 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:10.657416 18568 ts_tablet_manager.cc:1403] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.101s user 0.012s sys 0.003s
I20260204 08:59:10.658527 18570 raft_consensus.cc:359] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.659204 18570 raft_consensus.cc:385] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.659466 18570 raft_consensus.cc:740] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.659801 18568 raft_consensus.cc:359] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.660447 18568 raft_consensus.cc:385] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.660197 18570 consensus_queue.cc:260] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.660719 18568 raft_consensus.cc:740] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.663244 18634 raft_consensus.cc:2749] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.664675 18570 ts_tablet_manager.cc:1434] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.010s user 0.004s sys 0.001s
I20260204 08:59:10.665586 18570 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:10.656726 18569 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:10.668112 18569 ts_tablet_manager.cc:1403] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.009s
I20260204 08:59:10.670058 18570 tablet_bootstrap.cc:654] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.670619 18569 raft_consensus.cc:359] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.673030 18569 raft_consensus.cc:385] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.673367 18569 raft_consensus.cc:740] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.672676 18567 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:10.674317 18567 ts_tablet_manager.cc:1403] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.105s user 0.015s sys 0.008s
I20260204 08:59:10.676478 18568 consensus_queue.cc:260] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.676889 18567 raft_consensus.cc:359] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.678637 18568 ts_tablet_manager.cc:1434] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.021s user 0.003s sys 0.003s
I20260204 08:59:10.684379 18568 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:10.681710 18569 consensus_queue.cc:260] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.685217 18567 raft_consensus.cc:385] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.690613 18525 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.694131 18567 raft_consensus.cc:740] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.694639 18570 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:10.695806 18570 ts_tablet_manager.cc:1403] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.004s
I20260204 08:59:10.696064 18567 consensus_queue.cc:260] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.695279 18569 ts_tablet_manager.cc:1434] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.027s user 0.002s sys 0.003s
I20260204 08:59:10.698088 18569 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:10.698223 18570 raft_consensus.cc:359] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.699826 18570 raft_consensus.cc:385] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.700111 18570 raft_consensus.cc:740] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.705634 18570 consensus_queue.cc:260] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.699469 18567 ts_tablet_manager.cc:1434] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260204 08:59:10.692616 18568 tablet_bootstrap.cc:654] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.706961 18567 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:10.712136 18701 consensus_queue.cc:1048] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.714295 18570 ts_tablet_manager.cc:1434] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.018s user 0.004s sys 0.001s
I20260204 08:59:10.715250 18570 tablet_bootstrap.cc:492] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:10.715051 18648 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.715704 18648 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.717558 18648 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:10.719813 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:10.720227 18634 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.720682 18634 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.721432 18570 tablet_bootstrap.cc:654] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.722829 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.712558 18567 tablet_bootstrap.cc:654] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.723464 18449 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
W20260204 08:59:10.723573 18491 leader_election.cc:343] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.723964 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.724829 18488 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 08:59:10.725281 18340 leader_election.cc:343] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.722462 18634 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:10.726976 18648 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.727308 18648 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.727360 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:10.727733 18648 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:10.728614 18340 leader_election.cc:343] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.729074 18340 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:10.730163 18634 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.734954 18648 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.740253 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:10.740504 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:10.741039 18448 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:10.741927 18491 leader_election.cc:343] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.704960 18569 tablet_bootstrap.cc:654] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.744798 18648 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:10.747464 18448 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:10.748550 18488 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:10.749279 18648 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:10.749877 18648 raft_consensus.cc:697] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:10.750633 18570 tablet_bootstrap.cc:492] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:10.750653 18648 consensus_queue.cc:237] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.751579 18568 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:10.751391 18570 ts_tablet_manager.cc:1403] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.007s
I20260204 08:59:10.752039 18568 ts_tablet_manager.cc:1403] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.068s user 0.008s sys 0.022s
I20260204 08:59:10.756194 18570 raft_consensus.cc:359] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.756866 18570 raft_consensus.cc:385] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.756924 18567 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:10.757181 18577 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.757218 18570 raft_consensus.cc:740] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.757509 18567 ts_tablet_manager.cc:1403] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.000s
I20260204 08:59:10.757738 18577 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.757989 18570 consensus_queue.cc:260] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.759095 18668 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.759217 18568 raft_consensus.cc:359] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.759886 18568 raft_consensus.cc:385] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.759545 18668 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.760149 18568 raft_consensus.cc:740] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.760300 18570 ts_tablet_manager.cc:1434] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260204 08:59:10.761289 18570 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:10.761425 18668 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:10.762547 18567 raft_consensus.cc:359] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.763164 18567 raft_consensus.cc:385] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.763418 18567 raft_consensus.cc:740] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.763960 18701 consensus_queue.cc:1048] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:10.764071 18567 consensus_queue.cc:260] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.764400 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:10.765410 18568 consensus_queue.cc:260] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.759637 18577 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:10.763003 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.766958 18570 tablet_bootstrap.cc:654] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.767132 18449 raft_consensus.cc:2393] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:10.768343 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.768780 18265 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:10.770535 18567 ts_tablet_manager.cc:1434] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260204 08:59:10.763857 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:10.771418 18567 tablet_bootstrap.cc:492] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:10.772495 18491 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:10.773785 18577 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.774631 18668 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.777571 18568 ts_tablet_manager.cc:1434] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260204 08:59:10.781452 18569 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:10.784379 18569 ts_tablet_manager.cc:1403] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.087s user 0.013s sys 0.000s
I20260204 08:59:10.782473 18567 tablet_bootstrap.cc:654] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.793242 18568 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:10.803474 18668 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.794618 18569 raft_consensus.cc:359] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.804301 18697 consensus_queue.cc:1048] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.809741 18199 catalog_manager.cc:5654] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:10.807015 18671 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.816470 18671 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.819556 18699 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.819808 18671 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:10.820515 18569 raft_consensus.cc:385] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.820885 18569 raft_consensus.cc:740] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.823108 18699 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.823050 18569 consensus_queue.cc:260] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.824163 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:10.824802 18377 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:10.825830 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:10.826586 18300 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:10.827333 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:10.827715 18491 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:10.825911 18265 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:10.828784 18671 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.829226 18671 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.829723 18671 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.833326 18577 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.833729 18577 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.834074 18577 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.835573 18699 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:10.829169 18265 leader_election.cc:343] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.839639 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:10.841003 18488 leader_election.cc:343] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.841675 18568 tablet_bootstrap.cc:654] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.842403 18671 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.844579 18671 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:10.837255 18569 ts_tablet_manager.cc:1434] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.052s user 0.006s sys 0.000s
I20260204 08:59:10.845487 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:10.846060 18377 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.846410 18577 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.849053 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:10.849601 18300 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.852106 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
W20260204 08:59:10.855773 18265 leader_election.cc:343] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.857286 18567 tablet_bootstrap.cc:492] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:10.857851 18567 ts_tablet_manager.cc:1403] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.087s user 0.021s sys 0.000s
I20260204 08:59:10.860504 18377 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:10.852020 18569 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:10.861785 18265 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:10.862859 18671 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:10.863426 18300 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:10.863981 18671 raft_consensus.cc:697] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:10.864503 18491 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:10.860493 18567 raft_consensus.cc:359] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.864817 18671 consensus_queue.cc:237] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.865343 18648 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:10.867813 18567 raft_consensus.cc:385] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.868048 18648 raft_consensus.cc:697] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:10.868628 18569 tablet_bootstrap.cc:654] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.867130 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:10.869773 18488 leader_election.cc:343] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.869618 18648 consensus_queue.cc:237] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.870250 18568 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:10.868135 18567 raft_consensus.cc:740] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.870755 18568 ts_tablet_manager.cc:1403] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.078s user 0.006s sys 0.003s
I20260204 08:59:10.871028 18567 consensus_queue.cc:260] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.866281 18577 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:10.873347 18567 ts_tablet_manager.cc:1434] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260204 08:59:10.873172 18568 raft_consensus.cc:359] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.873817 18568 raft_consensus.cc:385] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.874073 18568 raft_consensus.cc:740] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.874768 18567 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:10.876390 18570 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:10.876820 18570 ts_tablet_manager.cc:1403] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.116s user 0.039s sys 0.047s
I20260204 08:59:10.879062 18570 raft_consensus.cc:359] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.879670 18570 raft_consensus.cc:385] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.879912 18570 raft_consensus.cc:740] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.880828 18567 tablet_bootstrap.cc:654] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.880553 18568 consensus_queue.cc:260] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.881580 18570 consensus_queue.cc:260] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.883721 18570 ts_tablet_manager.cc:1434] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260204 08:59:10.884605 18570 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:10.889952 18570 tablet_bootstrap.cc:654] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.895498 18199 catalog_manager.cc:5654] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:10.895680 18568 ts_tablet_manager.cc:1434] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20260204 08:59:10.903028 18567 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:10.900041 18200 catalog_manager.cc:5654] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:10.903491 18567 ts_tablet_manager.cc:1403] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.003s
I20260204 08:59:10.905934 18568 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:10.905823 18567 raft_consensus.cc:359] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.906503 18567 raft_consensus.cc:385] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.906756 18567 raft_consensus.cc:740] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.907260 18567 consensus_queue.cc:260] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.909373 18567 ts_tablet_manager.cc:1434] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:59:10.910344 18567 tablet_bootstrap.cc:492] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:10.912516 18568 tablet_bootstrap.cc:654] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.914611 18567 tablet_bootstrap.cc:654] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.929044 18570 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:10.930064 18695 consensus_queue.cc:1048] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.931239 18570 ts_tablet_manager.cc:1403] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.005s
I20260204 08:59:10.932286 18569 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:10.932788 18569 ts_tablet_manager.cc:1403] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.081s user 0.016s sys 0.000s
I20260204 08:59:10.934372 18570 raft_consensus.cc:359] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.934926 18567 tablet_bootstrap.cc:492] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:10.935693 18567 ts_tablet_manager.cc:1403] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.011s
I20260204 08:59:10.936486 18568 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:10.936914 18568 ts_tablet_manager.cc:1403] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.008s
I20260204 08:59:10.938416 18567 raft_consensus.cc:359] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.935040 18570 raft_consensus.cc:385] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.939472 18570 raft_consensus.cc:740] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.940193 18570 consensus_queue.cc:260] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.940932 18568 raft_consensus.cc:359] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.941850 18568 raft_consensus.cc:385] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.942109 18568 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.942579 18570 ts_tablet_manager.cc:1434] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260204 08:59:10.943038 18567 raft_consensus.cc:385] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.942786 18568 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.943389 18567 raft_consensus.cc:740] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.944185 18567 consensus_queue.cc:260] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:10.945057 18568 ts_tablet_manager.cc:1434] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260204 08:59:10.946002 18568 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:10.946421 18567 ts_tablet_manager.cc:1434] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260204 08:59:10.947425 18567 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:10.950794 18634 consensus_queue.cc:1048] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:10.935171 18569 raft_consensus.cc:359] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.952195 18570 tablet_bootstrap.cc:492] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:10.953346 18567 tablet_bootstrap.cc:654] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.952648 18569 raft_consensus.cc:385] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:10.954056 18569 raft_consensus.cc:740] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:10.951176 18568 tablet_bootstrap.cc:654] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.955245 18569 consensus_queue.cc:260] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:10.957296 18569 ts_tablet_manager.cc:1434] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260204 08:59:10.958220 18569 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:10.958796 18648 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.959254 18648 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.961229 18648 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:10.963001 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:10.963459 18569 tablet_bootstrap.cc:654] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.963626 18449 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:10.965451 18488 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:10.972625 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:10.975875 18491 leader_election.cc:343] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:10.976254 18648 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:10.976683 18648 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:10.977010 18648 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.980206 18570 tablet_bootstrap.cc:654] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:10.980302 18616 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:10.981022 18616 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:10.985688 18648 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:10.986369 18616 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:10.988704 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:10.988924 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:10.989805 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:10.990402 18448 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:10.997246 18417 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:10.998065 18616 raft_consensus.cc:2749] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:10.998900 18648 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.007889 18449 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.007958 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:11.012811 18491 leader_election.cc:343] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.015609 18448 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.017074 18488 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:11.018319 18648 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.019764 18648 raft_consensus.cc:697] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:11.020519 18648 consensus_queue.cc:237] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.021934 18570 tablet_bootstrap.cc:492] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:11.022414 18570 ts_tablet_manager.cc:1403] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.071s user 0.010s sys 0.000s
I20260204 08:59:11.024715 18697 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.025792 18668 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.026235 18697 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.026490 18668 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.028002 18570 raft_consensus.cc:359] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.028628 18570 raft_consensus.cc:385] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.028910 18570 raft_consensus.cc:740] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.029583 18570 consensus_queue.cc:260] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.031595 18568 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:11.032120 18568 ts_tablet_manager.cc:1403] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.086s user 0.019s sys 0.013s
I20260204 08:59:11.032480 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.033660 18697 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.034379 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.028731 18668 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.034998 18300 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:11.035066 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.036182 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:11.040572 18417 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:11.041425 18697 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.041780 18697 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.042140 18697 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.044348 18567 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:11.044800 18567 ts_tablet_manager.cc:1403] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.098s user 0.013s sys 0.004s
I20260204 08:59:11.035738 18568 raft_consensus.cc:359] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.047008 18568 raft_consensus.cc:385] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.047684 18568 raft_consensus.cc:740] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.049444 18697 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.051064 18265 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:11.035741 18377 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:11.052389 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:11.053001 18376 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.055696 18569 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.056173 18569 ts_tablet_manager.cc:1403] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.098s user 0.010s sys 0.007s
I20260204 08:59:11.056509 18522 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.057444 18570 ts_tablet_manager.cc:1434] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.035s user 0.006s sys 0.001s
I20260204 08:59:11.058542 18570 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:11.047252 18567 raft_consensus.cc:359] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.058892 18567 raft_consensus.cc:385] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.059167 18567 raft_consensus.cc:740] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.059849 18567 consensus_queue.cc:260] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.061790 18567 ts_tablet_manager.cc:1434] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260204 08:59:11.062657 18567 tablet_bootstrap.cc:492] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:11.058543 18569 raft_consensus.cc:359] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.064407 18569 raft_consensus.cc:385] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.064670 18569 raft_consensus.cc:740] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.065260 18671 raft_consensus.cc:2749] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:11.051363 18697 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.065826 18648 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.065289 18569 consensus_queue.cc:260] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.066294 18648 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.068317 18648 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.069777 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.070405 18377 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.068423 18569 ts_tablet_manager.cc:1434] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260204 08:59:11.071740 18570 tablet_bootstrap.cc:654] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.071539 18488 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:11.072672 18648 raft_consensus.cc:2804] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.073052 18648 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.073678 18648 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.076069 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.076745 18451 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.080022 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.080602 18300 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.071689 18569 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.084993 18376 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:11.088634 18414 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:11.087210 18300 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:11.089871 18697 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.090536 18697 raft_consensus.cc:697] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:11.064824 18200 catalog_manager.cc:5654] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:11.050618 18568 consensus_queue.cc:260] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.093852 18634 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.094265 18634 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.096493 18634 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.092242 18697 consensus_queue.cc:237] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.097790 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.097852 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.099634 18449 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:11.100126 18569 tablet_bootstrap.cc:654] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.099634 18300 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:11.098770 18648 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.100602 18340 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:11.103066 18567 tablet_bootstrap.cc:654] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.098968 18568 ts_tablet_manager.cc:1434] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.067s user 0.005s sys 0.000s
I20260204 08:59:11.103089 18634 raft_consensus.cc:2804] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.103714 18634 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.104120 18634 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.106419 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:11.107007 18449 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.107795 18616 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.108235 18616 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.111363 18616 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.111930 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.112520 18300 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:11.113281 18449 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.113583 18417 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:11.113978 18648 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.114761 18488 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:11.115526 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:11.116005 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:11.118510 18376 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:11.119061 18414 leader_election.cc:343] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.116149 18648 raft_consensus.cc:2804] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.121022 18648 raft_consensus.cc:697] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:11.122051 18568 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:11.124745 18616 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.121820 18648 consensus_queue.cc:237] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.125142 18616 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.125506 18616 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.117623 18634 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.128538 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.129061 18300 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.131198 18701 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.131724 18701 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.132939 18616 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.133499 18701 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:11.135363 18300 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:11.135699 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.136474 18343 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:11.136801 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.137347 18689 raft_consensus.cc:2804] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
W20260204 08:59:11.137863 18414 leader_election.cc:343] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.138083 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:11.137374 18301 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.139410 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:11.139448 18570 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:11.140017 18449 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.140606 18570 ts_tablet_manager.cc:1403] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.082s user 0.009s sys 0.015s
I20260204 08:59:11.139688 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:11.142768 18414 leader_election.cc:343] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:11.143450 18414 leader_election.cc:343] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.137953 18689 raft_consensus.cc:697] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:11.143865 18414 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:11.144593 18689 consensus_queue.cc:237] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.146101 18634 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.147127 18376 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.144927 18701 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:11.143606 18570 raft_consensus.cc:359] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.148741 18301 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:11.149046 18570 raft_consensus.cc:385] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.149380 18570 raft_consensus.cc:740] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.149850 18569 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.150327 18569 ts_tablet_manager.cc:1403] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.079s user 0.011s sys 0.000s
I20260204 08:59:11.150804 18570 consensus_queue.cc:260] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.151867 18417 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:11.152709 18701 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.152758 18569 raft_consensus.cc:359] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.153294 18701 raft_consensus.cc:697] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:11.153429 18570 ts_tablet_manager.cc:1434] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.013s user 0.002s sys 0.003s
I20260204 08:59:11.154635 18570 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:11.154210 18701 consensus_queue.cc:237] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.150956 18567 tablet_bootstrap.cc:492] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:11.156956 18567 ts_tablet_manager.cc:1403] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.095s user 0.012s sys 0.000s
I20260204 08:59:11.158388 18449 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:11.158874 18616 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.159895 18568 tablet_bootstrap.cc:654] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.160096 18569 raft_consensus.cc:385] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.160420 18569 raft_consensus.cc:740] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.161108 18569 consensus_queue.cc:260] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.161397 18199 catalog_manager.cc:5654] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:11.163266 18569 ts_tablet_manager.cc:1434] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260204 08:59:11.159862 18634 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.163966 18634 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.167618 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:11.167789 18197 catalog_manager.cc:5654] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
W20260204 08:59:11.169036 18340 leader_election.cc:343] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.172077 18634 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.172636 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:11.173952 18343 leader_election.cc:343] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.174360 18343 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:11.175359 18634 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:11.176564 18569 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.182386 18569 tablet_bootstrap.cc:654] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.187077 18568 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:11.187561 18568 ts_tablet_manager.cc:1403] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.067s user 0.010s sys 0.007s
I20260204 08:59:11.190121 18568 raft_consensus.cc:359] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.190776 18568 raft_consensus.cc:385] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.191075 18568 raft_consensus.cc:740] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.191807 18568 consensus_queue.cc:260] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.196978 18568 ts_tablet_manager.cc:1434] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260204 08:59:11.197757 18568 tablet_bootstrap.cc:492] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:11.198328 18199 catalog_manager.cc:5654] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:11.202898 18568 tablet_bootstrap.cc:654] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.204942 18198 catalog_manager.cc:5654] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:11.207770 18567 raft_consensus.cc:359] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.208666 18567 raft_consensus.cc:385] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.211752 18567 raft_consensus.cc:740] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.212491 18567 consensus_queue.cc:260] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.213271 18570 tablet_bootstrap.cc:654] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.214834 18567 ts_tablet_manager.cc:1434] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.058s user 0.005s sys 0.000s
W20260204 08:59:11.218281 18491 consensus_peers.cc:597] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:11.219703 18567 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:11.225307 18570 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:11.225770 18570 ts_tablet_manager.cc:1403] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.071s user 0.011s sys 0.003s
I20260204 08:59:11.226137 18648 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.226651 18648 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.228237 18570 raft_consensus.cc:359] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.228871 18648 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.228847 18570 raft_consensus.cc:385] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.229348 18570 raft_consensus.cc:740] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.230631 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.231335 18569 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.231814 18569 ts_tablet_manager.cc:1403] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.055s user 0.009s sys 0.025s
I20260204 08:59:11.234189 18569 raft_consensus.cc:359] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.234763 18569 raft_consensus.cc:385] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.235020 18569 raft_consensus.cc:740] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.235491 18570 consensus_queue.cc:260] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.237696 18570 ts_tablet_manager.cc:1434] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260204 08:59:11.235805 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.238538 18300 raft_consensus.cc:2393] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:11.239286 18569 consensus_queue.cc:260] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.240912 18567 tablet_bootstrap.cc:654] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.241986 18491 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:11.238544 18570 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:11.247349 18568 tablet_bootstrap.cc:492] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:11.247818 18568 ts_tablet_manager.cc:1403] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.019s
I20260204 08:59:11.248466 18569 ts_tablet_manager.cc:1434] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260204 08:59:11.249430 18569 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.250741 18568 raft_consensus.cc:359] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.251348 18568 raft_consensus.cc:385] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.251601 18568 raft_consensus.cc:740] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.252179 18568 consensus_queue.cc:260] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.254149 18568 ts_tablet_manager.cc:1434] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:59:11.255071 18577 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.257241 18570 tablet_bootstrap.cc:654] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.261574 18577 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:11.255502 18569 tablet_bootstrap.cc:654] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.270320 18568 tablet_bootstrap.cc:492] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:11.274375 18577 consensus_queue.cc:1048] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.277715 18568 tablet_bootstrap.cc:654] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.278537 18569 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.279090 18569 ts_tablet_manager.cc:1403] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.004s
I20260204 08:59:11.280968 18522 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.282140 18570 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:11.281852 18569 raft_consensus.cc:359] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.282666 18570 ts_tablet_manager.cc:1403] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.007s
I20260204 08:59:11.282744 18569 raft_consensus.cc:385] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.283185 18569 raft_consensus.cc:740] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.283841 18569 consensus_queue.cc:260] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.285126 18701 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.285588 18701 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.285996 18569 ts_tablet_manager.cc:1434] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260204 08:59:11.287120 18569 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.288780 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.289505 18376 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:11.289654 18577 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.290174 18577 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.291992 18577 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.292788 18569 tablet_bootstrap.cc:654] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.293292 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.293886 18376 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.293723 18765 consensus_queue.cc:1048] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.295804 18488 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:11.293684 18414 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:11.296515 18567 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:11.296540 18577 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.297068 18577 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.297161 18567 ts_tablet_manager.cc:1403] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.078s user 0.021s sys 0.010s
I20260204 08:59:11.287529 18701 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.299777 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.300441 18448 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.300565 18567 raft_consensus.cc:359] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.301286 18567 raft_consensus.cc:385] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.301553 18567 raft_consensus.cc:740] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.303861 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.304550 18300 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:11.306142 18569 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.306631 18569 ts_tablet_manager.cc:1403] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.004s
I20260204 08:59:11.297434 18577 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.309185 18569 raft_consensus.cc:359] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.310228 18569 raft_consensus.cc:385] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.311251 18569 raft_consensus.cc:740] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.311960 18569 consensus_queue.cc:260] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.312213 18567 consensus_queue.cc:260] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.313144 18616 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.313496 18616 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.313810 18616 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.314327 18569 ts_tablet_manager.cc:1434] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:59:11.315330 18569 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.318900 18671 consensus_queue.cc:1048] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.321592 18569 tablet_bootstrap.cc:654] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.330188 18567 ts_tablet_manager.cc:1434] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260204 08:59:11.331291 18567 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:11.322278 18616 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.338812 18570 raft_consensus.cc:359] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.339464 18570 raft_consensus.cc:385] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.339735 18570 raft_consensus.cc:740] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.340114 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.340764 18300 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.346261 18301 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.356873 18568 tablet_bootstrap.cc:492] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:11.340339 18570 consensus_queue.cc:260] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.357388 18568 ts_tablet_manager.cc:1403] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.087s user 0.014s sys 0.020s
I20260204 08:59:11.363068 18568 raft_consensus.cc:359] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.363715 18568 raft_consensus.cc:385] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.363987 18568 raft_consensus.cc:740] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.367841 18671 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.364616 18568 consensus_queue.cc:260] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.368427 18671 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.370476 18671 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:11.370690 18568 ts_tablet_manager.cc:1434] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260204 08:59:11.372290 18568 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:11.372507 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:11.359297 18570 ts_tablet_manager.cc:1434] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.035s user 0.004s sys 0.000s
I20260204 08:59:11.378247 18570 tablet_bootstrap.cc:492] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:11.378873 18577 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.381111 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.381914 18449 raft_consensus.cc:2393] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 1: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:11.382514 18616 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.384732 18570 tablet_bootstrap.cc:654] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.383661 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:11.386127 18377 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.359043 18300 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:11.392692 18568 tablet_bootstrap.cc:654] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.393850 18265 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:11.395407 18668 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.395785 18417 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:11.396943 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:11.399359 18375 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.401968 18668 raft_consensus.cc:2749] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:11.404247 18377 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:11.405578 18570 tablet_bootstrap.cc:492] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:11.406054 18570 ts_tablet_manager.cc:1403] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.000s
I20260204 08:59:11.406528 18375 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.407732 18488 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:11.408463 18570 raft_consensus.cc:359] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.409008 18699 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.409255 18570 raft_consensus.cc:385] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.409608 18699 raft_consensus.cc:697] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:11.410519 18699 consensus_queue.cc:237] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.414534 18616 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.415073 18616 raft_consensus.cc:697] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:11.392750 18376 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.417330 18577 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.418419 18568 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:11.418876 18568 ts_tablet_manager.cc:1403] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.002s
I20260204 08:59:11.419857 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:11.420449 18449 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.421360 18568 raft_consensus.cc:359] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.422011 18568 raft_consensus.cc:385] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.422272 18568 raft_consensus.cc:740] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.423025 18568 consensus_queue.cc:260] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.425408 18567 tablet_bootstrap.cc:654] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.409618 18570 raft_consensus.cc:740] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.427978 18568 ts_tablet_manager.cc:1434] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260204 08:59:11.429113 18568 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:11.428798 18570 consensus_queue.cc:260] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.431138 18570 ts_tablet_manager.cc:1434] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.025s user 0.006s sys 0.001s
I20260204 08:59:11.415918 18616 consensus_queue.cc:237] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.435113 18568 tablet_bootstrap.cc:654] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.436043 18689 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.436533 18689 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.438784 18689 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.440421 18570 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:11.440675 18301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.441299 18301 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:11.441407 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:11.442435 18343 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:11.445225 18575 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:11.445574 18575 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.445935 18575 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:11.446861 18569 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.447332 18569 ts_tablet_manager.cc:1403] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.132s user 0.043s sys 0.055s
I20260204 08:59:11.449959 18569 raft_consensus.cc:359] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.450606 18569 raft_consensus.cc:385] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.450872 18569 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.451552 18569 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.452560 18567 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:11.453073 18567 ts_tablet_manager.cc:1403] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.122s user 0.011s sys 0.000s
I20260204 08:59:11.454344 18569 ts_tablet_manager.cc:1434] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260204 08:59:11.455437 18567 raft_consensus.cc:359] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.456241 18567 raft_consensus.cc:385] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.456524 18567 raft_consensus.cc:740] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.457229 18567 consensus_queue.cc:260] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.450402 18570 tablet_bootstrap.cc:654] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.459239 18569 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.461112 18567 ts_tablet_manager.cc:1434] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260204 08:59:11.463052 18567 tablet_bootstrap.cc:492] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:11.465592 18569 tablet_bootstrap.cc:654] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.473527 18575 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.475064 18699 consensus_queue.cc:1048] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.476193 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:11.477463 18570 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:11.478324 18570 ts_tablet_manager.cc:1403] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.038s user 0.011s sys 0.002s
I20260204 08:59:11.478617 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.479310 18300 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:11.479364 18575 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.481051 18699 consensus_queue.cc:1048] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.482314 18699 consensus_queue.cc:1048] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.481585 18197 catalog_manager.cc:5654] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:11.489071 18300 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:11.489948 18301 raft_consensus.cc:1240] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260204 08:59:11.493710 18377 raft_consensus.cc:1240] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260204 08:59:11.495112 18648 consensus_queue.cc:1059] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.495870 18648 consensus_queue.cc:1059] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.496738 18648 raft_consensus.cc:3055] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:11.497073 18648 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:11.496963 18343 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:11.497831 18648 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.498692 18634 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:11.499040 18648 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:11.499150 18634 raft_consensus.cc:697] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:11.500033 18634 consensus_queue.cc:237] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.501099 18567 tablet_bootstrap.cc:654] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.505656 18570 raft_consensus.cc:359] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.506382 18570 raft_consensus.cc:385] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.506650 18570 raft_consensus.cc:740] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.507303 18570 consensus_queue.cc:260] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.512677 18567 tablet_bootstrap.cc:492] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:11.513152 18567 ts_tablet_manager.cc:1403] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.000s
I20260204 08:59:11.513326 18570 ts_tablet_manager.cc:1434] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260204 08:59:11.514282 18570 tablet_bootstrap.cc:492] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:11.515584 18567 raft_consensus.cc:359] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.516263 18567 raft_consensus.cc:385] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.516537 18567 raft_consensus.cc:740] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.517155 18567 consensus_queue.cc:260] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.515894 18449 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.519193 18567 ts_tablet_manager.cc:1434] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:59:11.519630 18570 tablet_bootstrap.cc:654] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.529481 18569 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.540848 18569 ts_tablet_manager.cc:1403] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.083s user 0.025s sys 0.029s
I20260204 08:59:11.543138 18699 consensus_queue.cc:1048] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.543408 18569 raft_consensus.cc:359] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.544093 18569 raft_consensus.cc:385] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.544368 18569 raft_consensus.cc:740] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.520293 18567 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:11.544942 18569 consensus_queue.cc:260] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.547188 18569 ts_tablet_manager.cc:1434] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:59:11.548379 18569 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.553587 18569 tablet_bootstrap.cc:654] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.550710 18200 catalog_manager.cc:5654] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:11.535043 18199 catalog_manager.cc:5654] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:11.570729 18568 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:11.571199 18568 ts_tablet_manager.cc:1403] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.142s user 0.016s sys 0.005s
I20260204 08:59:11.573670 18568 raft_consensus.cc:359] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.574309 18568 raft_consensus.cc:385] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.574576 18568 raft_consensus.cc:740] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.575168 18568 consensus_queue.cc:260] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.578974 18567 tablet_bootstrap.cc:654] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.581755 18568 ts_tablet_manager.cc:1434] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260204 08:59:11.582226 18616 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.582785 18568 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:11.585722 18570 tablet_bootstrap.cc:492] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:11.586205 18570 ts_tablet_manager.cc:1403] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.072s user 0.016s sys 0.009s
I20260204 08:59:11.582707 18616 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.588699 18568 tablet_bootstrap.cc:654] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.588677 18570 raft_consensus.cc:359] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.589450 18570 raft_consensus.cc:385] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.589720 18570 raft_consensus.cc:740] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.590404 18570 consensus_queue.cc:260] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.593538 18634 consensus_queue.cc:1048] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.596064 18570 ts_tablet_manager.cc:1434] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260204 08:59:11.597044 18570 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:11.598748 18616 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.602046 18569 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.602490 18569 ts_tablet_manager.cc:1403] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.054s user 0.014s sys 0.008s
I20260204 08:59:11.604828 18569 raft_consensus.cc:359] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.605437 18569 raft_consensus.cc:385] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.605690 18569 raft_consensus.cc:740] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.606364 18569 consensus_queue.cc:260] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.612478 18569 ts_tablet_manager.cc:1434] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260204 08:59:11.613400 18569 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.613700 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.614538 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:11.614796 18417 leader_election.cc:343] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.618278 18567 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:11.618731 18567 ts_tablet_manager.cc:1403] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.099s user 0.022s sys 0.018s
I20260204 08:59:11.618827 18570 tablet_bootstrap.cc:654] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.621129 18567 raft_consensus.cc:359] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.621762 18567 raft_consensus.cc:385] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.622007 18567 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.622467 18568 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:11.622896 18568 ts_tablet_manager.cc:1403] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.040s user 0.020s sys 0.013s
I20260204 08:59:11.622677 18567 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.624531 18689 consensus_queue.cc:1048] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.625111 18567 ts_tablet_manager.cc:1434] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260204 08:59:11.625502 18569 tablet_bootstrap.cc:654] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.625324 18568 raft_consensus.cc:359] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.625990 18568 raft_consensus.cc:385] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.626062 18567 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:11.626284 18568 raft_consensus.cc:740] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.627003 18568 consensus_queue.cc:260] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.629410 18568 ts_tablet_manager.cc:1434] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260204 08:59:11.630890 18568 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:11.632004 18567 tablet_bootstrap.cc:654] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.633409 18569 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.633862 18569 ts_tablet_manager.cc:1403] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.000s
I20260204 08:59:11.645817 18570 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:11.682644 18570 ts_tablet_manager.cc:1403] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.008s
I20260204 08:59:11.650779 18648 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.650481 18569 raft_consensus.cc:359] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.684288 18569 raft_consensus.cc:385] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.684213 18648 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.684603 18569 raft_consensus.cc:740] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.685210 18569 consensus_queue.cc:260] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.686147 18648 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.651751 18699 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.687332 18569 ts_tablet_manager.cc:1434] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.053s user 0.008s sys 0.000s
I20260204 08:59:11.670897 18577 consensus_queue.cc:1048] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260204 08:59:11.687032 18699 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.658201 18701 consensus_queue.cc:1048] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260204 08:59:11.689289 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.689553 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.690290 18448 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.690668 18648 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.691114 18648 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.691182 18570 raft_consensus.cc:359] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.691841 18570 raft_consensus.cc:385] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.692108 18570 raft_consensus.cc:740] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.692674 18570 consensus_queue.cc:260] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.693928 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.694851 18488 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:11.694865 18699 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.696130 18377 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.696766 18577 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.697124 18577 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.697453 18577 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.697795 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.698462 18448 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.694082 18648 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.633863 18376 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:11.703006 18765 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:11.700824 18488 leader_election.cc:343] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.706023 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:11.703454 18765 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.709064 18765 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:11.704326 18569 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.704229 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.710943 18300 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.703438 18414 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:11.711968 18491 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:11.706538 18570 ts_tablet_manager.cc:1434] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260204 08:59:11.714649 18616 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.711596 18577 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.718291 18616 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.718670 18616 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.719452 18577 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.702085 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.720110 18377 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.720456 18577 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.720796 18577 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.721109 18577 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.721163 18701 consensus_queue.cc:1048] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.682646 18568 tablet_bootstrap.cc:654] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.725308 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.727310 18699 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.727864 18699 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.730434 18699 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.730713 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.731326 18300 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:11.716454 18615 consensus_queue.cc:1048] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260204 08:59:11.732324 18697 consensus_queue.cc:1048] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:11.717975 18570 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:11.736930 18302 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.738905 18615 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.739383 18615 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.741235 18615 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.741532 18765 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.742049 18765 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.743942 18765 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.745054 18491 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:11.746374 18648 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.746719 18648 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.747021 18648 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.747399 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:11.750857 18265 leader_election.cc:343] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.752118 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:11.753314 18417 leader_election.cc:343] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.754474 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:11.755786 18414 leader_election.cc:343] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.756208 18414 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:11.757264 18615 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:11.760442 18577 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.793012 18570 tablet_bootstrap.cc:654] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.736963 18699 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.741165 18616 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.795130 18634 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.798586 18699 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 08:59:11.788646 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 82583.1us
I20260204 08:59:11.812357 18569 tablet_bootstrap.cc:654] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:11.813490 18577 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.805719 18634 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.808949 18699 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.824234 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.833441 18299 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.847438 18297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.848290 18297 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:11.849885 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:11.849954 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:11.847563 18568 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:11.851863 18568 ts_tablet_manager.cc:1403] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.221s user 0.030s sys 0.040s
I20260204 08:59:11.850558 18448 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.827529 18648 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.851166 18376 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.855115 18343 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:11.855938 18697 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.856400 18697 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.838712 18634 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.857435 18634 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.860116 18697 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.860579 18298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.860808 18648 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.861343 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.863521 18689 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:11.863747 18417 leader_election.cc:343] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.862870 18298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.863994 18300 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.864089 18689 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.864954 18616 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:11.866252 18567 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:11.866696 18567 ts_tablet_manager.cc:1403] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.241s user 0.060s sys 0.100s
I20260204 08:59:11.866838 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:11.858675 18634 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.868016 18634 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.864410 18298 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:11.869081 18567 raft_consensus.cc:359] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.869714 18567 raft_consensus.cc:385] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.869971 18567 raft_consensus.cc:740] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.870533 18567 consensus_queue.cc:260] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.872792 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:11.874488 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:11.874773 18567 ts_tablet_manager.cc:1434] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260204 08:59:11.875067 18374 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.875873 18567 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:11.878432 18699 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:11.880941 18689 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.882091 18299 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.884747 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:11.885344 18377 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.887274 18567 tablet_bootstrap.cc:654] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
W20260204 08:59:11.888198 18414 leader_election.cc:343] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.888569 18491 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:11.891693 18648 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.889128 18376 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.892514 18648 raft_consensus.cc:697] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:11.883981 18448 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.890327 18699 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.890726 18300 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.894833 18417 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:11.863174 18568 raft_consensus.cc:359] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.894187 18701 consensus_queue.cc:1048] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:11.892412 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:11.895023 18648 consensus_queue.cc:237] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.898077 18491 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:11.899725 18615 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.900121 18615 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.900439 18615 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.904407 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:11.905108 18522 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:11.907609 18816 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.908109 18816 raft_consensus.cc:697] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:11.909591 18568 raft_consensus.cc:385] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.909806 18568 raft_consensus.cc:740] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.896495 18634 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.910462 18568 consensus_queue.cc:260] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.915470 18375 raft_consensus.cc:2393] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:11.918586 18615 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.908845 18816 consensus_queue.cc:237] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:11.922284 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.921203 18377 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:11.921790 18569 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:11.923456 18569 ts_tablet_manager.cc:1403] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.219s user 0.011s sys 0.017s
I20260204 08:59:11.908861 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.928023 18374 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
W20260204 08:59:11.930256 18343 leader_election.cc:343] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.923038 18300 raft_consensus.cc:2393] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 1: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:11.937408 18695 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:11.938336 18695 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.939999 18569 raft_consensus.cc:359] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.940287 18695 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:11.940632 18569 raft_consensus.cc:385] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:11.940924 18569 raft_consensus.cc:740] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.941439 18569 consensus_queue.cc:260] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.926546 18634 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:11.942255 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:11.944020 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:11.945612 18568 ts_tablet_manager.cc:1434] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.094s user 0.005s sys 0.000s
I20260204 08:59:11.955358 18569 ts_tablet_manager.cc:1434] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.032s user 0.003s sys 0.002s
I20260204 08:59:11.959132 18568 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:11.947575 18299 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:11.961582 18567 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:11.961988 18567 ts_tablet_manager.cc:1403] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.086s user 0.011s sys 0.010s
I20260204 08:59:11.947721 18448 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:11.963456 18569 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:11.962769 18488 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:11.975456 18343 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:11.984477 18689 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:11.984948 18689 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:11.985265 18689 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.964895 18414 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:11.990257 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
W20260204 08:59:11.991459 18414 leader_election.cc:343] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:11.993652 18567 raft_consensus.cc:359] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.994055 18616 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:11.985337 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:11.994942 18300 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:11.996822 18568 tablet_bootstrap.cc:654] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.002599 18569 tablet_bootstrap.cc:654] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.005434 18300 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:12.008476 18417 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:12.009650 18697 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.010427 18697 raft_consensus.cc:697] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:12.011317 18697 consensus_queue.cc:237] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:11.994865 18567 raft_consensus.cc:385] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.015106 18567 raft_consensus.cc:740] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:11.976502 18615 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.015834 18567 consensus_queue.cc:260] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:11.979951 18648 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.032951 18567 ts_tablet_manager.cc:1434] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.071s user 0.007s sys 0.000s
I20260204 08:59:12.026728 18816 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.034528 18570 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:12.035040 18570 ts_tablet_manager.cc:1403] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.317s user 0.011s sys 0.010s
I20260204 08:59:12.027165 18616 raft_consensus.cc:697] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 08:59:12.023886 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 63268.1us
W20260204 08:59:12.038178 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 63707.6us
I20260204 08:59:12.039686 18816 raft_consensus.cc:697] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:12.039620 18570 raft_consensus.cc:359] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.046202 18570 raft_consensus.cc:385] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.046470 18570 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.040617 18615 consensus_queue.cc:1048] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.046591 18816 consensus_queue.cc:237] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.047353 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:12.027511 18689 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.048400 18810 consensus_queue.cc:1048] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:12.048363 18570 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.049551 18689 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:12.041590 18616 consensus_queue.cc:237] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.050549 18570 ts_tablet_manager.cc:1434] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260204 08:59:12.051491 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:12.051998 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:12.052277 18377 raft_consensus.cc:2393] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:12.052598 18299 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.053328 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:12.055961 18765 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:12.056670 18248 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:59:12.051712 18570 tablet_bootstrap.cc:492] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:12.058036 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.058346 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.059094 18811 consensus_queue.cc:1048] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.045658 18265 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:12.060112 18522 raft_consensus.cc:1275] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260204 08:59:12.060485 18522 pending_rounds.cc:85] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4: Aborting all ops after (but not including) 0
I20260204 08:59:12.060645 18671 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.060752 18522 pending_rounds.cc:107] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260204 08:59:12.061151 18522 raft_consensus.cc:2889] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:12.031824 18648 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.062667 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:12.064790 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:12.067386 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:12.067812 18568 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:12.067988 18451 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:12.068157 18340 leader_election.cc:343] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.068611 18340 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:12.069310 18634 raft_consensus.cc:2749] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.068181 18648 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.071841 18570 tablet_bootstrap.cc:654] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.072018 18634 consensus_queue.cc:1048] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.075086 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:12.077270 18568 ts_tablet_manager.cc:1403] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.120s user 0.017s sys 0.000s
I20260204 08:59:12.083092 18299 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:12.047947 18449 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.084313 18343 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:12.084690 18340 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:12.085840 18695 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.086452 18695 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.086850 18695 raft_consensus.cc:697] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:12.060503 18265 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:12.087638 18695 consensus_queue.cc:237] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.089496 18668 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:12.089854 18668 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:12.090178 18668 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.095866 18568 raft_consensus.cc:359] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.096567 18568 raft_consensus.cc:385] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.096812 18568 raft_consensus.cc:740] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.056427 18765 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.097388 18568 consensus_queue.cc:260] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.098129 18300 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:12.099049 18765 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:12.100150 18568 ts_tablet_manager.cc:1434] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260204 08:59:12.104405 18568 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:12.098266 18668 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.108170 18668 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:12.111109 18299 raft_consensus.cc:1275] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260204 08:59:12.087746 18488 leader_election.cc:343] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.112526 18575 consensus_queue.cc:1048] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.112725 18491 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:12.113571 18577 raft_consensus.cc:2804] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:12.113915 18577 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:12.114240 18577 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:12.115806 18488 leader_election.cc:343] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.124910 18822 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.125428 18822 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.127669 18577 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.047968 18567 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:12.129701 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.130741 18577 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:12.131071 18414 leader_election.cc:343] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.130613 18810 consensus_queue.cc:1048] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.131734 18822 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.131898 18449 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:12.132414 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:12.124424 18451 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:12.133088 18299 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:12.138373 18265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 49242.9us
I20260204 08:59:12.151367 18569 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:12.151887 18569 ts_tablet_manager.cc:1403] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.189s user 0.013s sys 0.014s
I20260204 08:59:12.155403 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:12.158322 18297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:12.159128 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:12.159173 18265 leader_election.cc:343] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.164179 18570 tablet_bootstrap.cc:492] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:12.164700 18570 ts_tablet_manager.cc:1403] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.113s user 0.010s sys 0.020s
I20260204 08:59:12.161540 18197 catalog_manager.cc:5654] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:12.170555 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:12.170068 18197 catalog_manager.cc:5654] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:12.167337 18570 raft_consensus.cc:359] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.176267 18570 raft_consensus.cc:385] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.176694 18570 raft_consensus.cc:740] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.176645 18568 tablet_bootstrap.cc:654] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.178274 18570 consensus_queue.cc:260] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.179152 18569 raft_consensus.cc:359] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.181205 18569 raft_consensus.cc:385] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.181526 18569 raft_consensus.cc:740] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
W20260204 08:59:12.185195 18417 leader_election.cc:343] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.185662 18417 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:12.186450 18822 raft_consensus.cc:2749] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260204 08:59:12.187196 18265 leader_election.cc:343] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.188386 18569 consensus_queue.cc:260] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.191438 18570 ts_tablet_manager.cc:1434] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.026s user 0.005s sys 0.001s
I20260204 08:59:12.193378 18570 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:12.196880 18568 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:12.197326 18568 ts_tablet_manager.cc:1403] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.093s user 0.015s sys 0.000s
I20260204 08:59:12.200258 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:12.201000 18810 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.201436 18810 raft_consensus.cc:697] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:12.201893 18567 tablet_bootstrap.cc:654] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.202394 18568 raft_consensus.cc:359] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.202188 18810 consensus_queue.cc:237] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:12.203742 18488 leader_election.cc:343] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.204262 18568 raft_consensus.cc:385] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.205557 18568 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.206079 18568 consensus_queue.cc:260] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.207302 18569 ts_tablet_manager.cc:1434] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.055s user 0.002s sys 0.004s
I20260204 08:59:12.208319 18569 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:12.213413 18570 tablet_bootstrap.cc:654] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.223403 18568 ts_tablet_manager.cc:1434] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260204 08:59:12.224421 18568 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:12.226356 18196 catalog_manager.cc:5654] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:12.231105 18568 tablet_bootstrap.cc:654] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.235144 18569 tablet_bootstrap.cc:654] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.237457 18570 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:12.237629 18299 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:12.238090 18570 ts_tablet_manager.cc:1403] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.045s user 0.017s sys 0.000s
I20260204 08:59:12.238899 18491 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:12.239723 18577 raft_consensus.cc:2804] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.240399 18577 raft_consensus.cc:697] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:12.241151 18577 consensus_queue.cc:237] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.243695 18570 raft_consensus.cc:359] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.244318 18570 raft_consensus.cc:385] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.244587 18570 raft_consensus.cc:740] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.245173 18570 consensus_queue.cc:260] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.246794 18567 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:12.247267 18567 ts_tablet_manager.cc:1403] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.200s user 0.006s sys 0.009s
I20260204 08:59:12.248158 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.249796 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:12.250312 18525 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.253345 18567 raft_consensus.cc:359] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.253985 18567 raft_consensus.cc:385] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.254237 18567 raft_consensus.cc:740] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.250349 18570 ts_tablet_manager.cc:1434] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260204 08:59:12.256992 18570 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:12.258903 18567 consensus_queue.cc:260] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.263206 18567 ts_tablet_manager.cc:1434] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.016s user 0.002s sys 0.003s
I20260204 08:59:12.264137 18567 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:12.275324 18567 tablet_bootstrap.cc:654] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.276902 18695 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.277451 18695 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.278752 18570 tablet_bootstrap.cc:654] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.280465 18695 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.281507 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:12.282958 18343 leader_election.cc:343] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.277649 18525 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:12.284765 18265 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:12.287889 18671 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.295125 18200 catalog_manager.cc:5654] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:12.300947 18200 catalog_manager.cc:5654] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:12.303308 18200 catalog_manager.cc:5654] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:12.309427 18569 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:12.309818 18569 ts_tablet_manager.cc:1403] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.102s user 0.007s sys 0.026s
I20260204 08:59:12.311713 18569 raft_consensus.cc:359] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.314467 18569 raft_consensus.cc:385] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.314674 18569 raft_consensus.cc:740] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.315203 18569 consensus_queue.cc:260] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.318468 18569 ts_tablet_manager.cc:1434] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.008s user 0.003s sys 0.002s
I20260204 08:59:12.319562 18569 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:12.325486 18569 tablet_bootstrap.cc:654] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.329607 18265 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:12.330526 18668 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.330444 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.331118 18668 raft_consensus.cc:697] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:12.332165 18668 consensus_queue.cc:237] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:12.336712 18340 leader_election.cc:343] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.337208 18340 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:12.340999 18695 raft_consensus.cc:2749] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.342336 18568 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:12.342818 18568 ts_tablet_manager.cc:1403] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.119s user 0.021s sys 0.009s
I20260204 08:59:12.345304 18567 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:12.345781 18567 ts_tablet_manager.cc:1403] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.082s user 0.014s sys 0.013s
I20260204 08:59:12.347909 18569 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:12.348424 18569 ts_tablet_manager.cc:1403] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.000s
I20260204 08:59:12.348312 18567 raft_consensus.cc:359] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.349390 18570 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:12.349822 18570 ts_tablet_manager.cc:1403] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.093s user 0.008s sys 0.001s
I20260204 08:59:12.349005 18567 raft_consensus.cc:385] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.350293 18567 raft_consensus.cc:740] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.345345 18568 raft_consensus.cc:359] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.351832 18568 raft_consensus.cc:385] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.351251 18567 consensus_queue.cc:260] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.352080 18570 raft_consensus.cc:359] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.352731 18570 raft_consensus.cc:385] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.352985 18570 raft_consensus.cc:740] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.352110 18568 raft_consensus.cc:740] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.353798 18567 ts_tablet_manager.cc:1434] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260204 08:59:12.354205 18568 consensus_queue.cc:260] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.356446 18567 tablet_bootstrap.cc:492] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:12.362228 18568 ts_tablet_manager.cc:1434] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260204 08:59:12.351258 18569 raft_consensus.cc:359] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.362937 18569 raft_consensus.cc:385] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.363267 18568 tablet_bootstrap.cc:492] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:12.363219 18569 raft_consensus.cc:740] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.363965 18569 consensus_queue.cc:260] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.366456 18569 ts_tablet_manager.cc:1434] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260204 08:59:12.367398 18569 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:12.369102 18570 consensus_queue.cc:260] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.371356 18570 ts_tablet_manager.cc:1434] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.021s user 0.006s sys 0.001s
I20260204 08:59:12.372347 18570 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:12.373169 18569 tablet_bootstrap.cc:654] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.362277 18567 tablet_bootstrap.cc:654] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.369690 18671 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.375722 18671 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.374626 18199 catalog_manager.cc:5654] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:12.377529 18570 tablet_bootstrap.cc:654] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.378692 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:12.377569 18671 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:12.379966 18372 raft_consensus.cc:2393] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 1: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:12.381031 18568 tablet_bootstrap.cc:654] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.393939 18648 consensus_queue.cc:1048] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:12.404700 18200 catalog_manager.cc:5654] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:12.406201 18200 catalog_manager.cc:5654] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:12.408038 18697 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.408562 18697 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.408903 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:12.410486 18697 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:12.411765 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:12.412114 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:12.412882 18265 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:12.413479 18414 leader_election.cc:343] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:12.414522 18417 leader_election.cc:343] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.414924 18417 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:12.415979 18697 raft_consensus.cc:2749] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.417060 18671 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.431710 18671 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.424646 18567 tablet_bootstrap.cc:492] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:12.434010 18567 ts_tablet_manager.cc:1403] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.078s user 0.009s sys 0.010s
I20260204 08:59:12.439689 18570 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:12.440181 18570 ts_tablet_manager.cc:1403] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.068s user 0.014s sys 0.013s
I20260204 08:59:12.443074 18570 raft_consensus.cc:359] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.443636 18570 raft_consensus.cc:385] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.443926 18570 raft_consensus.cc:740] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.444656 18570 consensus_queue.cc:260] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.446791 18570 ts_tablet_manager.cc:1434] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260204 08:59:12.447190 18567 raft_consensus.cc:359] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.447927 18567 raft_consensus.cc:385] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.448006 18570 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:12.448218 18567 raft_consensus.cc:740] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.448890 18567 consensus_queue.cc:260] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.450292 18568 tablet_bootstrap.cc:492] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:12.450688 18568 ts_tablet_manager.cc:1403] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.088s user 0.020s sys 0.009s
I20260204 08:59:12.453591 18569 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:12.454057 18569 ts_tablet_manager.cc:1403] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.087s user 0.016s sys 0.000s
I20260204 08:59:12.457784 18568 raft_consensus.cc:359] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.458458 18568 raft_consensus.cc:385] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.458717 18568 raft_consensus.cc:740] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.458791 18570 tablet_bootstrap.cc:654] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.459367 18568 consensus_queue.cc:260] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.460253 18567 ts_tablet_manager.cc:1434] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20260204 08:59:12.461344 18567 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:12.468379 18648 consensus_queue.cc:1048] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.470769 18570 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:12.472009 18570 ts_tablet_manager.cc:1403] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.007s
I20260204 08:59:12.461560 18568 ts_tablet_manager.cc:1434] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260204 08:59:12.462287 18822 consensus_queue.cc:1048] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.475236 18668 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.462688 18671 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.463183 18689 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.475762 18668 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.476424 18671 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.476470 18689 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.477694 18668 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:12.478370 18671 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:12.478745 18689 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:12.479627 18568 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:12.480433 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:12.480489 18569 raft_consensus.cc:359] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.481384 18569 raft_consensus.cc:385] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.481285 18445 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:12.482177 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:12.482450 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:12.482882 18447 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:12.484149 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.485000 18522 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:12.485628 18569 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.486367 18569 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:12.487210 18265 leader_election.cc:343] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.489668 18265 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:12.490002 18570 raft_consensus.cc:359] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.490796 18265 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:12.490640 18570 raft_consensus.cc:385] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.491564 18570 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.488456 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:12.492473 18668 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:12.492255 18570 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.492837 18668 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:12.493184 18668 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.494380 18838 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:12.494753 18838 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:12.495061 18838 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.495113 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:12.498000 18343 leader_election.cc:343] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.498474 18697 consensus_queue.cc:1048] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.501955 18838 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.503266 18570 ts_tablet_manager.cc:1434] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20260204 08:59:12.504598 18648 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:59:12.508442 18340 leader_election.cc:343] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.508884 18340 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:12.505051 18570 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:12.509994 18695 raft_consensus.cc:2749] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.511875 18838 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:12.514518 18568 tablet_bootstrap.cc:654] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.516091 18695 consensus_queue.cc:1048] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.516338 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:12.516932 18522 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.515870 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:12.520223 18832 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.520994 18447 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.520696 18832 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.525825 18832 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.527778 18567 tablet_bootstrap.cc:654] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.530615 18832 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.530843 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:12.534315 18488 leader_election.cc:343] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.549238 18570 tablet_bootstrap.cc:654] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.554708 18569 ts_tablet_manager.cc:1434] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.100s user 0.008s sys 0.000s
I20260204 08:59:12.548555 18832 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.550022 18648 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.562515 18569 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:12.551262 18822 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.545303 18668 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.566509 18822 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.567020 18648 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.585011 18648 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.578301 18697 consensus_queue.cc:1048] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260204 08:59:12.586948 18810 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.587460 18810 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.588706 18822 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:12.589417 18810 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:12.589948 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.590592 18525 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:12.567204 18832 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.592461 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:12.593024 18373 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:12.593297 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:12.593976 18374 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:12.594096 18832 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.596071 18414 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:12.597100 18296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:12.597502 18616 raft_consensus.cc:2804] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:12.597743 18296 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:12.598485 18616 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:12.598726 18298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:12.599761 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:12.601156 18491 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:12.601431 18298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:12.601513 18488 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:12.601799 18616 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.602181 18298 raft_consensus.cc:2393] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:12.602873 18577 raft_consensus.cc:2804] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:12.603262 18577 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:12.603552 18577 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:12.608445 18491 leader_election.cc:343] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.608876 18491 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:12.609591 18648 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:12.609937 18648 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:12.610239 18648 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.610422 18832 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.616834 18577 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.621315 18577 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:12.630926 18488 leader_election.cc:343] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.629571 18616 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.589977 18810 consensus_queue.cc:1048] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260204 08:59:12.633410 18522 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:12.643221 18525 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.650594 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:12.651187 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:12.651679 18448 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.647591 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:12.651378 18451 raft_consensus.cc:2393] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:12.652766 18372 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:12.653532 18872 log.cc:927] Time spent T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.073s user 0.000s sys 0.001s
I20260204 08:59:12.655848 18648 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.656013 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:12.646523 18567 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:12.662518 18567 ts_tablet_manager.cc:1403] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.201s user 0.010s sys 0.005s
I20260204 08:59:12.665498 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:12.666098 18302 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.666627 18567 raft_consensus.cc:359] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.667275 18567 raft_consensus.cc:385] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.671458 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:12.676405 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:12.678156 18265 leader_election.cc:343] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.667514 18567 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.679154 18648 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.659189 18569 tablet_bootstrap.cc:654] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.659673 18668 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:12.661373 18697 consensus_queue.cc:1048] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.679601 18567 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.693472 18567 ts_tablet_manager.cc:1434] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.031s user 0.001s sys 0.004s
I20260204 08:59:12.696424 18568 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:12.696996 18568 ts_tablet_manager.cc:1403] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.218s user 0.010s sys 0.009s
I20260204 08:59:12.703486 18447 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:12.678875 18810 consensus_queue.cc:1048] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260204 08:59:12.699471 18840 consensus_queue.cc:1048] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260204 08:59:12.700125 18616 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:12.712766 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:12.713563 18525 raft_consensus.cc:2393] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 1: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:12.714884 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:12.715482 18265 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:12.716472 18671 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.716935 18671 raft_consensus.cc:697] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:12.717752 18671 consensus_queue.cc:237] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.719982 18414 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:12.715502 18447 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.730386 18822 raft_consensus.cc:2749] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.732635 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:12.733227 18448 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.737027 18832 consensus_queue.cc:1048] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.738358 18840 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.738816 18840 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.739737 18828 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.740250 18828 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.742161 18828 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.744277 18374 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.744902 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.755868 18840 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:12.745240 18372 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:12.759305 18568 raft_consensus.cc:359] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.761838 18298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:12.762960 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 83944.8us
I20260204 08:59:12.767944 18296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:12.759984 18568 raft_consensus.cc:385] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.769841 18568 raft_consensus.cc:740] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.770298 18568 consensus_queue.cc:260] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.770902 18488 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:12.751559 18302 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:12.777462 18491 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:12.778515 18567 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:12.778813 18810 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.766855 18447 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:12.781062 18810 raft_consensus.cc:697] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:12.783571 18810 consensus_queue.cc:237] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.785118 18568 ts_tablet_manager.cc:1434] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.088s user 0.006s sys 0.001s
I20260204 08:59:12.794749 18568 tablet_bootstrap.cc:492] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:12.801765 18567 tablet_bootstrap.cc:654] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.806187 18570 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:12.806679 18570 ts_tablet_manager.cc:1403] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.302s user 0.014s sys 0.028s
I20260204 08:59:12.806851 18488 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:12.807621 18577 raft_consensus.cc:2804] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.809110 18577 raft_consensus.cc:697] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:12.809728 18577 consensus_queue.cc:237] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:12.819772 18448 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:12.804627 18832 raft_consensus.cc:2749] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:12.802590 18668 consensus_queue.cc:1048] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260204 08:59:12.824007 18569 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:12.824554 18569 ts_tablet_manager.cc:1403] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.262s user 0.018s sys 0.010s
I20260204 08:59:12.829357 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:12.805377 18878 consensus_queue.cc:1048] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260204 08:59:12.805526 18816 consensus_queue.cc:1048] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260204 08:59:12.836510 18570 raft_consensus.cc:359] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.836760 18569 raft_consensus.cc:359] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.837157 18570 raft_consensus.cc:385] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.837428 18569 raft_consensus.cc:385] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:12.837874 18569 raft_consensus.cc:740] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.838491 18569 consensus_queue.cc:260] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.837477 18570 raft_consensus.cc:740] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:12.840592 18570 consensus_queue.cc:260] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.816072 18417 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:12.850723 18569 ts_tablet_manager.cc:1434] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20260204 08:59:12.845336 18523 raft_consensus.cc:2393] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 1: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:12.859339 18570 ts_tablet_manager.cc:1434] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.052s user 0.006s sys 0.001s
I20260204 08:59:12.862114 18568 tablet_bootstrap.cc:654] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.854457 18616 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:12.869230 18569 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
W20260204 08:59:12.861128 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 55593.4us
I20260204 08:59:12.873749 18887 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.871497 18570 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:12.881301 18887 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:12.888362 18570 tablet_bootstrap.cc:654] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.888898 18340 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:12.889946 18887 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:12.885067 18200 catalog_manager.cc:5654] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:12.891389 18265 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:12.893591 18668 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.894059 18668 raft_consensus.cc:697] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:12.894840 18668 consensus_queue.cc:237] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:12.898442 18569 tablet_bootstrap.cc:654] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:12.900444 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:12.919516 18488 consensus_peers.cc:597] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Couldn't send request to peer 44601d9bf1ce4a70a5b01dcfc505d276. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:12.921840 18671 consensus_queue.cc:1048] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:12.912226 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:12.938867 18376 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:12.950073 18488 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:12.950963 18878 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:12.951356 18878 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:12.951685 18878 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:12.941587 18689 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260204 08:59:12.977656 18491 leader_election.cc:343] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:12.951946 18810 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:12.987083 18810 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:12.990455 18570 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:12.990940 18570 ts_tablet_manager.cc:1403] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.121s user 0.008s sys 0.004s
I20260204 08:59:12.975333 18878 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.003902 18567 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:13.002543 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:13.003607 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:13.006366 18375 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.003607 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:13.004555 18567 ts_tablet_manager.cc:1403] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.226s user 0.014s sys 0.004s
I20260204 08:59:13.014756 18567 raft_consensus.cc:359] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.015213 18567 raft_consensus.cc:385] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.015424 18567 raft_consensus.cc:740] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
W20260204 08:59:13.015877 18491 leader_election.cc:343] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.016136 18568 tablet_bootstrap.cc:492] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
W20260204 08:59:13.016490 18491 leader_election.cc:343] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.016615 18568 ts_tablet_manager.cc:1403] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.222s user 0.010s sys 0.002s
I20260204 08:59:13.002532 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.017911 18567 consensus_queue.cc:260] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.018996 18568 raft_consensus.cc:359] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.019564 18567 ts_tablet_manager.cc:1434] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260204 08:59:13.019675 18568 raft_consensus.cc:385] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.002743 18878 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:13.020714 18567 tablet_bootstrap.cc:492] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:13.021258 18375 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:13.001605 18810 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:13.001528 18198 catalog_manager.cc:5654] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:13.026747 18569 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:13.027256 18569 ts_tablet_manager.cc:1403] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.164s user 0.012s sys 0.000s
I20260204 08:59:13.030593 18567 tablet_bootstrap.cc:654] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.032722 18488 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:13.034529 18810 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:12.999558 18570 raft_consensus.cc:359] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.035686 18570 raft_consensus.cc:385] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.036485 18570 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.035770 18568 raft_consensus.cc:740] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.037045 18570 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:13.038162 18488 leader_election.cc:343] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.039018 18488 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:13.037657 18810 raft_consensus.cc:697] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:13.040931 18832 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:13.041170 18810 consensus_queue.cc:237] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.038069 18568 consensus_queue.cc:260] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.049502 18570 ts_tablet_manager.cc:1434] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.058s user 0.007s sys 0.000s
I20260204 08:59:13.050486 18570 tablet_bootstrap.cc:492] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:13.056030 18568 ts_tablet_manager.cc:1434] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.039s user 0.006s sys 0.001s
I20260204 08:59:13.058233 18569 raft_consensus.cc:359] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.058930 18569 raft_consensus.cc:385] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.059186 18569 raft_consensus.cc:740] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.059799 18569 consensus_queue.cc:260] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.064632 18568 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:13.075241 18569 ts_tablet_manager.cc:1434] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.045s user 0.008s sys 0.000s
I20260204 08:59:13.076095 18567 tablet_bootstrap.cc:492] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:13.076691 18567 ts_tablet_manager.cc:1403] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.056s user 0.012s sys 0.008s
I20260204 08:59:13.081719 18569 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:13.082377 18196 catalog_manager.cc:5654] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:13.084208 18196 catalog_manager.cc:5654] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:13.087917 18569 tablet_bootstrap.cc:654] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.089764 18567 raft_consensus.cc:359] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.091199 18568 tablet_bootstrap.cc:654] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.091428 18567 raft_consensus.cc:385] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.091745 18567 raft_consensus.cc:740] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.092374 18567 consensus_queue.cc:260] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.095283 18567 ts_tablet_manager.cc:1434] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.018s user 0.001s sys 0.005s
I20260204 08:59:13.096287 18567 tablet_bootstrap.cc:492] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:13.101918 18569 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:13.102458 18569 ts_tablet_manager.cc:1403] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.008s
I20260204 08:59:13.104063 18567 tablet_bootstrap.cc:654] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.105934 18568 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:13.105994 18569 raft_consensus.cc:359] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.106596 18568 ts_tablet_manager.cc:1403] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.043s user 0.011s sys 0.000s
I20260204 08:59:13.106808 18569 raft_consensus.cc:385] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.107095 18569 raft_consensus.cc:740] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.107702 18569 consensus_queue.cc:260] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.109767 18569 ts_tablet_manager.cc:1434] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260204 08:59:13.110679 18569 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:13.109530 18568 raft_consensus.cc:359] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.111194 18568 raft_consensus.cc:385] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.111508 18568 raft_consensus.cc:740] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.122241 18568 consensus_queue.cc:260] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.111878 18765 consensus_queue.cc:1048] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:13.116103 18569 tablet_bootstrap.cc:654] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.133934 18568 ts_tablet_manager.cc:1434] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260204 08:59:13.139163 18568 tablet_bootstrap.cc:492] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:13.152778 18568 tablet_bootstrap.cc:654] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.158195 18200 catalog_manager.cc:5654] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:13.159854 18569 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:13.169414 18569 ts_tablet_manager.cc:1403] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.059s user 0.018s sys 0.014s
W20260204 08:59:13.163151 18248 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:59:13.165782 18568 tablet_bootstrap.cc:492] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:13.172268 18569 raft_consensus.cc:359] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.172894 18569 raft_consensus.cc:385] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.173023 18568 ts_tablet_manager.cc:1403] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.005s
I20260204 08:59:13.173302 18569 raft_consensus.cc:740] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.173926 18569 consensus_queue.cc:260] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.174309 18840 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.174770 18840 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.176633 18840 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:13.179404 18569 ts_tablet_manager.cc:1434] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260204 08:59:13.179319 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:13.180059 18300 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:13.180557 18569 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:13.181243 18343 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:13.182415 18840 raft_consensus.cc:2804] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:13.182760 18840 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:13.183068 18840 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.186192 18765 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.186810 18765 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.189420 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.190049 18447 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:13.194687 18569 tablet_bootstrap.cc:654] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.194684 18810 consensus_queue.cc:1048] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:13.197477 18870 consensus_queue.cc:1048] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:13.197702 18765 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:13.204079 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:13.204772 18375 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:13.206090 18898 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.206619 18898 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.204845 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.210381 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.211018 18523 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:13.206539 18265 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:13.212047 18870 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:13.212406 18870 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:13.212316 18414 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:13.212955 18870 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:13.212486 18265 leader_election.cc:343] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.214797 18899 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:13.215171 18899 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:13.215494 18899 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.219376 18568 raft_consensus.cc:359] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.221053 18816 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.224454 18816 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.226361 18816 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:13.227910 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:13.228376 18840 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:13.229434 18491 leader_election.cc:343] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.230160 18840 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:13.230990 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:13.231228 18810 consensus_queue.cc:1048] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:59:13.232545 18488 leader_election.cc:343] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.232915 18570 tablet_bootstrap.cc:654] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.232929 18488 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:13.233453 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:13.234004 18299 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.234856 18810 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:13.237713 18567 tablet_bootstrap.cc:492] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:13.238200 18567 ts_tablet_manager.cc:1403] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.142s user 0.030s sys 0.057s
I20260204 08:59:13.238265 18898 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:13.239508 18568 raft_consensus.cc:385] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.239907 18568 raft_consensus.cc:740] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.241009 18568 consensus_queue.cc:260] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.245887 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:13.247592 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 08:59:13.248119 18417 leader_election.cc:343] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.248211 18445 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.281311 18695 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.281908 18695 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.315887 18567 raft_consensus.cc:359] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.316627 18567 raft_consensus.cc:385] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.316881 18567 raft_consensus.cc:740] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.317466 18567 consensus_queue.cc:260] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.318048 18870 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.319795 18567 ts_tablet_manager.cc:1434] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.081s user 0.012s sys 0.004s
I20260204 08:59:13.321054 18445 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:13.320767 18899 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.322371 18695 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:13.323189 18899 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:13.324644 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.325318 18450 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:13.328502 18340 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:13.331662 18689 raft_consensus.cc:2804] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:13.332125 18689 raft_consensus.cc:697] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:13.332653 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:13.333292 18523 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.332918 18689 consensus_queue.cc:237] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.342358 18523 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:13.357434 18871 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.361347 18871 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.350613 18765 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.345016 18340 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:13.364017 18414 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:13.364436 18765 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.364998 18898 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:13.365487 18898 raft_consensus.cc:697] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:13.366364 18765 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:13.366325 18898 consensus_queue.cc:237] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.367170 18871 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:13.369563 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:13.370416 18375 raft_consensus.cc:2393] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 1: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:13.371856 18569 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:13.372390 18569 ts_tablet_manager.cc:1403] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.192s user 0.047s sys 0.056s
I20260204 08:59:13.374521 18695 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:13.374981 18695 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:13.375492 18695 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.374558 18689 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.376341 18689 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.378186 18870 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:13.378738 18689 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:13.380748 18375 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.381256 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.381888 18450 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:13.384194 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.384616 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:13.385357 18522 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:13.363291 18299 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:13.386322 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.384073 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.386719 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.379171 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:13.387514 18376 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.374933 18569 raft_consensus.cc:359] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.388597 18569 raft_consensus.cc:385] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.320760 18567 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:13.388820 18695 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.390654 18695 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:13.388849 18569 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.391798 18569 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.393878 18569 ts_tablet_manager.cc:1434] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
W20260204 08:59:13.394068 18265 leader_election.cc:343] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.394721 18265 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:13.395334 18567 tablet_bootstrap.cc:654] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.395515 18265 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:13.396734 18871 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:13.397099 18871 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:13.397425 18871 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.398787 18870 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.400352 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:13.400923 18450 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.407909 18450 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:13.410851 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:13.411810 18568 ts_tablet_manager.cc:1434] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.238s user 0.007s sys 0.000s
I20260204 08:59:13.412885 18568 tablet_bootstrap.cc:492] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:13.420881 18568 tablet_bootstrap.cc:654] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.420800 18878 consensus_queue.cc:1048] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:13.422086 18671 consensus_queue.cc:1048] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:13.413381 18871 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.402946 18198 catalog_manager.cc:5654] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
W20260204 08:59:13.410318 18340 leader_election.cc:343] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:13.424147 18340 leader_election.cc:343] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:13.424770 18340 leader_election.cc:343] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.425391 18340 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:13.426182 18695 raft_consensus.cc:2804] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:13.426528 18695 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:13.427034 18695 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.429957 18569 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:13.431854 18878 consensus_queue.cc:1048] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:13.426509 18340 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:13.444890 18695 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.449906 18569 tablet_bootstrap.cc:654] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.454855 18695 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:13.458448 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:13.459041 18522 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.439625 18840 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:13.425415 18871 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:13.468786 18570 tablet_bootstrap.cc:492] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:13.472580 18570 ts_tablet_manager.cc:1403] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.422s user 0.019s sys 0.035s
I20260204 08:59:13.470479 18840 raft_consensus.cc:697] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:13.475520 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:13.475924 18840 consensus_queue.cc:237] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:13.476830 18340 leader_election.cc:343] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.479417 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:13.483047 18445 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.491104 18445 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:13.513964 18522 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:13.516108 18265 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:13.517529 18671 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:13.518049 18671 raft_consensus.cc:697] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:13.518688 18340 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:13.516562 18376 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:13.524727 18922 raft_consensus.cc:2804] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
W20260204 08:59:13.525043 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 276946us
I20260204 08:59:13.542544 18570 raft_consensus.cc:359] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.549959 18570 raft_consensus.cc:385] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.550287 18570 raft_consensus.cc:740] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.550994 18570 consensus_queue.cc:260] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.559582 18570 ts_tablet_manager.cc:1434] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.087s user 0.006s sys 0.001s
I20260204 08:59:13.547685 18922 raft_consensus.cc:697] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:13.570606 18265 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:13.575150 18570 tablet_bootstrap.cc:492] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:13.572713 18668 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:13.554214 18671 consensus_queue.cc:237] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:13.587280 18567 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:13.587888 18567 ts_tablet_manager.cc:1403] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.267s user 0.094s sys 0.059s
I20260204 08:59:13.590646 18567 raft_consensus.cc:359] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.591338 18567 raft_consensus.cc:385] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.591627 18567 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.592327 18567 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.593396 18870 raft_consensus.cc:2749] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:13.594722 18567 ts_tablet_manager.cc:1434] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260204 08:59:13.595916 18567 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:13.595947 18198 catalog_manager.cc:5654] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:13.601051 18569 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:13.601590 18569 ts_tablet_manager.cc:1403] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.172s user 0.003s sys 0.014s
I20260204 08:59:13.612051 18668 raft_consensus.cc:697] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:13.617517 18668 consensus_queue.cc:237] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.602213 18922 consensus_queue.cc:237] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.596002 18888 consensus_queue.cc:1048] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260204 08:59:13.627444 18568 tablet_bootstrap.cc:492] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:13.627951 18568 ts_tablet_manager.cc:1403] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.215s user 0.034s sys 0.039s
I20260204 08:59:13.630522 18568 raft_consensus.cc:359] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.631194 18568 raft_consensus.cc:385] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.634505 18570 tablet_bootstrap.cc:654] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.631454 18568 raft_consensus.cc:740] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.643164 18568 consensus_queue.cc:260] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.646848 18568 ts_tablet_manager.cc:1434] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260204 08:59:13.648010 18568 tablet_bootstrap.cc:492] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:13.653017 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:13.653714 18568 tablet_bootstrap.cc:654] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.663826 18878 consensus_queue.cc:1048] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:13.669653 18569 raft_consensus.cc:359] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.670378 18569 raft_consensus.cc:385] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.670562 18567 tablet_bootstrap.cc:654] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.670655 18569 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.671381 18569 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.684427 18569 ts_tablet_manager.cc:1434] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.083s user 0.006s sys 0.001s
I20260204 08:59:13.685391 18569 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:13.688577 18197 catalog_manager.cc:5654] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:13.694128 18671 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.694659 18671 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.697832 18671 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:13.700285 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:13.708549 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.709209 18525 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:13.715389 18200 catalog_manager.cc:5654] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:13.718132 18200 catalog_manager.cc:5654] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:13.730145 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.733831 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:13.737293 18196 catalog_manager.cc:5654] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:13.742604 18569 tablet_bootstrap.cc:654] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.750236 18265 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 08:59:13.753091 18265 leader_election.cc:343] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.753347 18668 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:13.755159 18668 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:13.755503 18668 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:13.755666 18265 leader_election.cc:343] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.755911 18927 consensus_queue.cc:1048] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260204 08:59:13.761364 18417 leader_election.cc:343] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.762387 18922 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.762954 18922 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:13.765717 18265 leader_election.cc:343] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.766341 18816 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.767360 18816 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.769449 18816 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:13.767539 18840 consensus_queue.cc:1048] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:13.774184 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:13.782109 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.788216 18922 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:13.789377 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.789987 18567 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:13.792214 18340 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:13.796329 18922 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:13.798947 18568 tablet_bootstrap.cc:492] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:13.799465 18568 ts_tablet_manager.cc:1403] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.152s user 0.019s sys 0.011s
I20260204 08:59:13.801837 18568 raft_consensus.cc:359] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.802459 18568 raft_consensus.cc:385] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.802695 18568 raft_consensus.cc:740] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.803232 18568 consensus_queue.cc:260] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.803961 18567 ts_tablet_manager.cc:1403] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.208s user 0.010s sys 0.013s
I20260204 08:59:13.805022 18570 tablet_bootstrap.cc:492] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:13.806537 18568 ts_tablet_manager.cc:1434] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260204 08:59:13.807751 18568 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:13.810341 18570 ts_tablet_manager.cc:1403] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.238s user 0.009s sys 0.009s
I20260204 08:59:13.838207 18567 raft_consensus.cc:359] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.838797 18567 raft_consensus.cc:385] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.839005 18567 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.839463 18567 consensus_queue.cc:260] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.845093 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.845911 18448 raft_consensus.cc:2393] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:13.846931 18568 tablet_bootstrap.cc:654] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.854909 18922 consensus_queue.cc:1048] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:13.864153 18488 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:13.867772 18567 ts_tablet_manager.cc:1434] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.063s user 0.005s sys 0.000s
I20260204 08:59:13.867633 18888 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.875543 18567 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:13.872349 18570 raft_consensus.cc:359] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.877040 18922 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.877336 18570 raft_consensus.cc:385] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.877724 18570 raft_consensus.cc:740] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.878391 18570 consensus_queue.cc:260] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.882730 18888 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:13.882860 18671 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.883356 18671 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.814237 18668 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:13.895088 18570 ts_tablet_manager.cc:1434] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.084s user 0.005s sys 0.001s
I20260204 08:59:13.893810 18898 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.887949 18922 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:13.906091 18570 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:13.901556 18898 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.916445 18671 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:13.922526 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:13.922938 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.927754 18451 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:13.926234 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:13.928417 18340 leader_election.cc:343] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.929708 18898 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:13.929944 18265 leader_election.cc:343] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.932883 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:13.934154 18414 leader_election.cc:343] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.935998 18265 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:13.936991 18671 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:13.937346 18671 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:13.937657 18671 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.918416 18922 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:13.944109 18569 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:13.943938 18671 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.944566 18569 ts_tablet_manager.cc:1403] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.259s user 0.021s sys 0.014s
I20260204 08:59:13.945683 18671 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:13.946803 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:13.947347 18668 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:13.963742 18265 leader_election.cc:343] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.965217 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:13.965678 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:13.965878 18451 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.966369 18568 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:13.966879 18568 ts_tablet_manager.cc:1403] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.159s user 0.009s sys 0.010s
I20260204 08:59:13.966401 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:13.967777 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:13.972059 18523 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:13.973181 18451 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
W20260204 08:59:13.967519 18265 leader_election.cc:343] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.975756 18570 tablet_bootstrap.cc:654] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.976522 18265 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:13.969849 18568 raft_consensus.cc:359] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.977332 18568 raft_consensus.cc:385] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.977550 18568 raft_consensus.cc:740] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.978024 18568 consensus_queue.cc:260] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.946794 18569 raft_consensus.cc:359] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:13.978888 18567 tablet_bootstrap.cc:654] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:13.979789 18569 raft_consensus.cc:385] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:13.983628 18569 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:13.967306 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:13.979926 18668 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:13.987423 18568 ts_tablet_manager.cc:1434] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.020s user 0.002s sys 0.004s
I20260204 08:59:13.988250 18569 consensus_queue.cc:260] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:13.989952 18340 leader_election.cc:343] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:13.995232 18340 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:13.980378 18888 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:13.993284 18523 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:14.000077 18568 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:14.005028 18898 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.009133 18265 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:14.005551 18898 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.001223 18840 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:14.016942 18374 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.012665 18569 ts_tablet_manager.cc:1434] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.068s user 0.003s sys 0.004s
I20260204 08:59:14.014452 18671 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:14.021763 18671 raft_consensus.cc:697] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:14.022588 18671 consensus_queue.cc:237] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.029588 18898 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:14.031747 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:14.032469 18376 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:14.033577 18414 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:14.035869 18899 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:14.036232 18899 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:14.036571 18899 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.037467 18568 tablet_bootstrap.cc:654] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.042014 18828 consensus_queue.cc:1048] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:14.002771 18668 raft_consensus.cc:697] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:14.043969 18668 consensus_queue.cc:237] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.003391 18888 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.045509 18525 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:14.053471 18417 consensus_peers.cc:597] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:14.061412 18899 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.063691 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:14.064435 18302 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:14.063385 18569 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:14.083865 18888 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:14.087908 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:14.090524 18300 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.089852 18570 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:14.091382 18570 ts_tablet_manager.cc:1403] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.185s user 0.016s sys 0.004s
I20260204 08:59:14.098373 18567 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:14.098803 18567 ts_tablet_manager.cc:1403] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.224s user 0.016s sys 0.038s
I20260204 08:59:14.100390 18200 catalog_manager.cc:5654] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:14.102236 18417 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:14.103370 18899 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:14.105636 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:14.105268 18898 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:14.106303 18377 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.092657 18840 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260204 08:59:14.099192 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:14.108358 18447 raft_consensus.cc:2393] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:14.111820 18567 raft_consensus.cc:359] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.112552 18567 raft_consensus.cc:385] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.112815 18567 raft_consensus.cc:740] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.105772 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:14.116842 18570 raft_consensus.cc:359] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.117533 18570 raft_consensus.cc:385] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.117792 18570 raft_consensus.cc:740] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.118376 18570 consensus_queue.cc:260] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.121920 18922 consensus_queue.cc:1048] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:14.113425 18567 consensus_queue.cc:260] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.107950 18840 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260204 08:59:14.131829 18377 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:14.134385 18414 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:14.134476 18265 consensus_peers.cc:597] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab -> Peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Couldn't send request to peer c61e83e5fb7445e8bce7eca695977903. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:14.135090 18616 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:14.135588 18616 raft_consensus.cc:697] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:14.136409 18616 consensus_queue.cc:237] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.139739 18300 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:14.140432 18488 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:14.141911 18567 ts_tablet_manager.cc:1434] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.043s user 0.006s sys 0.000s
I20260204 08:59:14.121999 18570 ts_tablet_manager.cc:1434] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.030s user 0.005s sys 0.000s
I20260204 08:59:14.143777 18570 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:14.142771 18934 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:14.152227 18521 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:14.150415 18947 log.cc:927] Time spent T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
I20260204 08:59:14.155411 18567 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
W20260204 08:59:14.168056 18949 log.cc:927] Time spent T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20260204 08:59:14.174038 18569 tablet_bootstrap.cc:654] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.196923 18198 catalog_manager.cc:5654] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:14.180171 18668 consensus_queue.cc:1048] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260204 08:59:14.201494 18567 tablet_bootstrap.cc:654] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.201714 18840 consensus_queue.cc:1048] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260204 08:59:14.226655 18927 consensus_queue.cc:1048] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:14.249953 18927 consensus_queue.cc:1048] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260204 08:59:14.254541 18568 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:14.255054 18568 ts_tablet_manager.cc:1403] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.255s user 0.013s sys 0.004s
I20260204 08:59:14.259884 18570 tablet_bootstrap.cc:654] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.260134 18568 raft_consensus.cc:359] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.260792 18568 raft_consensus.cc:385] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.261063 18568 raft_consensus.cc:740] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.261646 18568 consensus_queue.cc:260] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.269838 18568 ts_tablet_manager.cc:1434] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.015s user 0.003s sys 0.004s
I20260204 08:59:14.278796 18568 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:14.326529 18568 tablet_bootstrap.cc:654] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.339921 18828 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.340523 18828 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.342504 18828 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:14.350478 18569 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:14.351014 18569 ts_tablet_manager.cc:1403] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.296s user 0.010s sys 0.030s
I20260204 08:59:14.353736 18569 raft_consensus.cc:359] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.354393 18569 raft_consensus.cc:385] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.358676 18569 raft_consensus.cc:740] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.360839 18569 consensus_queue.cc:260] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.366755 18200 catalog_manager.cc:5654] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:14.386575 18569 ts_tablet_manager.cc:1434] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.035s user 0.006s sys 0.003s
I20260204 08:59:14.386154 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:14.389653 18569 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:14.395329 18374 raft_consensus.cc:2468] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 0.
I20260204 08:59:14.403254 18296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:14.408594 18568 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:14.412272 18568 ts_tablet_manager.cc:1403] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.134s user 0.008s sys 0.004s
I20260204 08:59:14.409806 18567 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:14.414181 18567 ts_tablet_manager.cc:1403] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.264s user 0.013s sys 0.022s
I20260204 08:59:14.417266 18414 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:14.418138 18616 raft_consensus.cc:2804] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:14.418491 18616 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:14.418794 18616 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.419162 18569 tablet_bootstrap.cc:654] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
W20260204 08:59:14.420605 18417 leader_election.cc:343] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:14.425699 18616 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.436215 18299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:14.437134 18616 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:14.437420 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:14.438027 18376 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
W20260204 08:59:14.445259 18417 leader_election.cc:343] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:14.451570 18376 raft_consensus.cc:2468] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:14.458762 18414 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:14.464078 18828 raft_consensus.cc:2804] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:14.464571 18828 raft_consensus.cc:697] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:14.465343 18828 consensus_queue.cc:237] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:14.459038 18568 raft_consensus.cc:359] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.468056 18568 raft_consensus.cc:385] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.468374 18568 raft_consensus.cc:740] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.469005 18568 consensus_queue.cc:260] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.469935 18567 raft_consensus.cc:359] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.470554 18567 raft_consensus.cc:385] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.470747 18567 raft_consensus.cc:740] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.474968 18567 consensus_queue.cc:260] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:14.475729 18248 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260204 08:59:14.471033 18296 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.484364 18898 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.484820 18898 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.486686 18898 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:14.488425 18570 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:14.488927 18570 ts_tablet_manager.cc:1403] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.345s user 0.011s sys 0.013s
I20260204 08:59:14.490753 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:14.492002 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:14.492245 18414 leader_election.cc:343] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:14.493115 18417 leader_election.cc:343] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:14.491323 18570 raft_consensus.cc:359] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.493490 18417 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:14.493680 18570 raft_consensus.cc:385] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.494006 18570 raft_consensus.cc:740] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.494601 18570 consensus_queue.cc:260] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.496735 18570 ts_tablet_manager.cc:1434] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260204 08:59:14.497488 18616 raft_consensus.cc:2749] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:14.496886 18962 consensus_queue.cc:1048] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260204 08:59:14.516244 18570 tablet_bootstrap.cc:492] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:14.518483 18695 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.518996 18695 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.522326 18570 tablet_bootstrap.cc:654] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.526990 18569 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:14.527410 18569 ts_tablet_manager.cc:1403] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.138s user 0.020s sys 0.028s
I20260204 08:59:14.547914 18695 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:14.551038 18568 ts_tablet_manager.cc:1434] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.138s user 0.004s sys 0.005s
I20260204 08:59:14.552412 18569 raft_consensus.cc:359] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.553135 18569 raft_consensus.cc:385] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.553403 18569 raft_consensus.cc:740] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.554029 18569 consensus_queue.cc:260] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.562649 18567 ts_tablet_manager.cc:1434] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.148s user 0.008s sys 0.000s
I20260204 08:59:14.569672 18568 tablet_bootstrap.cc:492] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:14.581015 18569 ts_tablet_manager.cc:1434] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.053s user 0.008s sys 0.000s
I20260204 08:59:14.581843 18567 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:14.599633 18569 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:14.582736 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:14.637428 18196 catalog_manager.cc:5654] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 0 to 1, leader changed from <none> to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 1 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:14.641140 18898 consensus_queue.cc:1048] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:14.643319 18567 tablet_bootstrap.cc:654] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.637447 18569 tablet_bootstrap.cc:654] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.647328 18568 tablet_bootstrap.cc:654] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.650055 18297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:14.651582 18343 leader_election.cc:343] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:14.652004 18962 consensus_queue.cc:1048] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260204 08:59:14.670679 18340 leader_election.cc:343] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:14.671103 18340 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:14.672260 18695 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:14.672851 18695 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.673311 18695 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.675244 18695 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:14.677979 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:14.678674 18302 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
W20260204 08:59:14.683061 18265 consensus_peers.cc:597] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab -> Peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Couldn't send request to peer 44601d9bf1ce4a70a5b01dcfc505d276. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:14.683127 18977 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.683746 18977 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.685719 18977 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:14.690115 18343 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:14.691020 18922 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:14.691390 18922 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:14.691817 18922 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.692518 18567 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:14.692977 18567 ts_tablet_manager.cc:1403] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.127s user 0.010s sys 0.002s
I20260204 08:59:14.700193 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:14.702409 18522 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:14.704890 18570 tablet_bootstrap.cc:492] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:14.705384 18570 ts_tablet_manager.cc:1403] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.190s user 0.018s sys 0.001s
I20260204 08:59:14.706207 18567 raft_consensus.cc:359] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.706885 18567 raft_consensus.cc:385] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.707155 18567 raft_consensus.cc:740] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.707814 18570 raft_consensus.cc:359] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.707746 18567 consensus_queue.cc:260] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.708451 18570 raft_consensus.cc:385] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.708689 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:14.709163 18265 consensus_peers.cc:597] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab -> Peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883): Couldn't send request to peer 44601d9bf1ce4a70a5b01dcfc505d276. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:14.711076 18567 ts_tablet_manager.cc:1434] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.018s user 0.009s sys 0.001s
I20260204 08:59:14.711570 18451 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.712062 18567 tablet_bootstrap.cc:492] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:14.713092 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:14.714560 18300 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:14.724026 18491 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:14.708721 18570 raft_consensus.cc:740] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.711077 18568 tablet_bootstrap.cc:492] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:14.725881 18568 ts_tablet_manager.cc:1403] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.164s user 0.011s sys 0.006s
I20260204 08:59:14.726763 18567 tablet_bootstrap.cc:654] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.725907 18570 consensus_queue.cc:260] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.728855 18570 ts_tablet_manager.cc:1434] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
W20260204 08:59:14.728507 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 124252us
I20260204 08:59:14.729980 18570 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:14.727284 18975 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:14.735760 18975 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:14.736122 18975 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.749533 18568 raft_consensus.cc:359] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.758517 18568 raft_consensus.cc:385] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.760313 18922 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.754350 18570 tablet_bootstrap.cc:654] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.761598 18374 raft_consensus.cc:2393] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:14.760978 18568 raft_consensus.cc:740] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.763833 18568 consensus_queue.cc:260] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.777891 18568 ts_tablet_manager.cc:1434] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.052s user 0.002s sys 0.003s
I20260204 08:59:14.760174 18975 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.785854 18300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:14.786561 18300 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.790470 18975 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:14.797128 18568 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:14.805704 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:14.806526 18374 raft_consensus.cc:2393] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 1: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:14.817772 18922 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:14.818738 18302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:14.821830 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:14.822633 18522 raft_consensus.cc:2393] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 1: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:14.822781 18977 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.823570 18977 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.825924 18977 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:14.837015 18570 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:14.842832 18570 ts_tablet_manager.cc:1403] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.113s user 0.011s sys 0.000s
I20260204 08:59:14.844206 18828 consensus_queue.cc:1048] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:14.837092 18340 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:14.845695 18300 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:14.846513 18570 raft_consensus.cc:359] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.846804 18491 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:14.847581 18977 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:14.848136 18977 raft_consensus.cc:697] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:14.848695 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:14.849177 18567 tablet_bootstrap.cc:492] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:14.845635 18922 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260204 08:59:14.849664 18567 ts_tablet_manager.cc:1403] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.138s user 0.035s sys 0.055s
I20260204 08:59:14.848954 18977 consensus_queue.cc:237] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.849328 18374 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:14.851558 18569 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:14.852039 18569 ts_tablet_manager.cc:1403] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.257s user 0.010s sys 0.013s
I20260204 08:59:14.847325 18570 raft_consensus.cc:385] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.852713 18570 raft_consensus.cc:740] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.853441 18570 consensus_queue.cc:260] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.854125 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:14.856431 18570 ts_tablet_manager.cc:1434] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260204 08:59:14.858731 18568 tablet_bootstrap.cc:654] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.858922 18570 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:14.862262 18567 raft_consensus.cc:359] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.862933 18567 raft_consensus.cc:385] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.863219 18567 raft_consensus.cc:740] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.863831 18567 consensus_queue.cc:260] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:14.862340 18488 leader_election.cc:343] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:14.879585 18488 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:14.880327 18974 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:14.880709 18974 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:14.881028 18974 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.869247 18569 raft_consensus.cc:359] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.887784 18569 raft_consensus.cc:385] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.888104 18569 raft_consensus.cc:740] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.889055 18570 tablet_bootstrap.cc:654] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.888918 18569 consensus_queue.cc:260] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.893638 18567 ts_tablet_manager.cc:1434] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.044s user 0.006s sys 0.001s
I20260204 08:59:14.894624 18567 tablet_bootstrap.cc:492] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:14.901429 18567 tablet_bootstrap.cc:654] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.902215 18568 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:14.902740 18568 ts_tablet_manager.cc:1403] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.006s
I20260204 08:59:14.906205 18569 ts_tablet_manager.cc:1434] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.054s user 0.004s sys 0.002s
I20260204 08:59:14.907181 18569 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:14.909988 18974 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.911929 18974 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:14.912595 18568 raft_consensus.cc:359] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.908070 18200 catalog_manager.cc:5654] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:14.914664 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:14.914721 18568 raft_consensus.cc:385] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.915334 18568 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.915266 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:14.916026 18448 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.915213 18376 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.916309 18568 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.926651 18448 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:14.927425 18568 ts_tablet_manager.cc:1434] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.024s user 0.008s sys 0.000s
I20260204 08:59:14.928439 18568 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:14.928742 18488 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:14.930047 18977 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:14.913887 18569 tablet_bootstrap.cc:654] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.930516 18977 raft_consensus.cc:697] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:14.931349 18977 consensus_queue.cc:237] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.926535 18376 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:14.946564 18964 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.947036 18964 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.949172 18964 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:14.952044 18570 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:14.952605 18570 ts_tablet_manager.cc:1403] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.094s user 0.009s sys 0.010s
I20260204 08:59:14.953814 18567 tablet_bootstrap.cc:492] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:14.954294 18567 ts_tablet_manager.cc:1403] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.060s user 0.010s sys 0.000s
I20260204 08:59:14.955401 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:14.956302 18374 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:14.958473 18567 raft_consensus.cc:359] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.959169 18567 raft_consensus.cc:385] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.959436 18567 raft_consensus.cc:740] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.960175 18567 consensus_queue.cc:260] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:14.961179 18265 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:14.962338 18567 ts_tablet_manager.cc:1434] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.008s user 0.003s sys 0.002s
I20260204 08:59:14.963328 18567 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903: Bootstrap starting.
I20260204 08:59:14.965018 18570 raft_consensus.cc:359] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.965694 18570 raft_consensus.cc:385] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:14.965950 18570 raft_consensus.cc:740] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.966177 18568 tablet_bootstrap.cc:654] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.966625 18570 consensus_queue.cc:260] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.969564 18668 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:14.974663 18668 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:14.975030 18668 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.974792 18977 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.976095 18570 ts_tablet_manager.cc:1434] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.023s user 0.005s sys 0.001s
I20260204 08:59:14.975890 18977 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:14.976994 18570 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:14.969822 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:14.980507 18296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:14.981268 18265 leader_election.cc:343] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:14.981328 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:14.981989 18451 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:14.983019 18570 tablet_bootstrap.cc:654] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:14.971982 18567 tablet_bootstrap.cc:654] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903: Neither blocks nor log segments found. Creating new log.
W20260204 08:59:14.984148 18491 leader_election.cc:343] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:14.970737 18200 catalog_manager.cc:5654] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:14.971864 18922 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:14.985037 18922 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:14.986963 18922 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:14.988946 18488 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:14.989027 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:14.990764 18296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:14.996497 18888 raft_consensus.cc:2804] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:14.997547 18340 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:14.996898 18888 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:14.999260 18888 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:14.999943 18922 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:14.996938 18977 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:15.006928 18568 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:15.007330 18568 ts_tablet_manager.cc:1403] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.079s user 0.008s sys 0.004s
I20260204 08:59:15.007603 18888 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.009915 18570 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:15.009737 18568 raft_consensus.cc:359] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:15.010429 18568 raft_consensus.cc:385] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.010488 18570 ts_tablet_manager.cc:1403] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.005s
I20260204 08:59:15.010753 18568 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:14.983987 18668 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.011497 18568 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:15.013432 18570 raft_consensus.cc:359] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.014153 18570 raft_consensus.cc:385] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.014463 18570 raft_consensus.cc:740] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.015139 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:15.015187 18570 consensus_queue.cc:260] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.016310 18522 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.017876 18570 ts_tablet_manager.cc:1434] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260204 08:59:15.018586 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:15.018921 18570 tablet_bootstrap.cc:492] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:15.019155 18376 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.023026 18522 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:15.025005 18570 tablet_bootstrap.cc:654] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:15.025367 18376 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:15.026445 18265 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:15.027221 18964 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:15.027745 18964 raft_consensus.cc:697] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:15.028502 18964 consensus_queue.cc:237] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.034395 18568 ts_tablet_manager.cc:1434] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.027s user 0.004s sys 0.004s
I20260204 08:59:15.035388 18569 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:15.035948 18569 ts_tablet_manager.cc:1403] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.129s user 0.014s sys 0.000s
I20260204 08:59:15.038056 18668 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:15.042398 18296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:15.043787 18491 leader_election.cc:343] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:15.045977 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:15.046671 18448 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.050570 18888 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:15.053813 18417 consensus_peers.cc:597] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:15.055620 18567 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903: No bootstrap required, opened a new log
I20260204 08:59:15.056442 18567 ts_tablet_manager.cc:1403] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903: Time spent bootstrapping tablet: real 0.093s user 0.010s sys 0.000s
I20260204 08:59:15.059140 18200 catalog_manager.cc:5654] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:15.063589 18567 raft_consensus.cc:359] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.064320 18567 raft_consensus.cc:385] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.064582 18567 raft_consensus.cc:740] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.065243 18567 consensus_queue.cc:260] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.067592 18567 ts_tablet_manager.cc:1434] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260204 08:59:15.087711 18448 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:15.088891 18488 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:15.089471 18568 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276: Bootstrap starting.
I20260204 08:59:15.090103 18888 raft_consensus.cc:2804] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:15.090708 18888 raft_consensus.cc:697] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:15.091488 18888 consensus_queue.cc:237] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.095710 18568 tablet_bootstrap.cc:654] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:15.038570 18569 raft_consensus.cc:359] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:15.098121 18569 raft_consensus.cc:385] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.098419 18569 raft_consensus.cc:740] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.099001 18569 consensus_queue.cc:260] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:15.100914 18976 consensus_queue.cc:1048] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.101420 18569 ts_tablet_manager.cc:1434] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.065s user 0.005s sys 0.000s
I20260204 08:59:15.102442 18569 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:15.112155 18570 tablet_bootstrap.cc:492] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:15.112672 18570 ts_tablet_manager.cc:1403] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.094s user 0.040s sys 0.044s
I20260204 08:59:15.118091 18568 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276: No bootstrap required, opened a new log
I20260204 08:59:15.118503 18569 tablet_bootstrap.cc:654] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:15.118607 18568 ts_tablet_manager.cc:1403] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.001s
I20260204 08:59:15.121205 18568 raft_consensus.cc:359] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.121812 18568 raft_consensus.cc:385] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.122056 18568 raft_consensus.cc:740] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.122706 18568 consensus_queue.cc:260] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.132495 18568 ts_tablet_manager.cc:1434] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent starting tablet: real 0.013s user 0.005s sys 0.002s
I20260204 08:59:15.140863 18198 catalog_manager.cc:5654] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:15.136365 18570 raft_consensus.cc:359] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:15.144753 18570 raft_consensus.cc:385] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.145030 18570 raft_consensus.cc:740] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.148044 18570 consensus_queue.cc:260] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:15.150277 18570 ts_tablet_manager.cc:1434] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.037s user 0.005s sys 0.001s
I20260204 08:59:15.151233 18570 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4: Bootstrap starting.
I20260204 08:59:15.155274 18569 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:15.155776 18569 ts_tablet_manager.cc:1403] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.004s
I20260204 08:59:15.156500 18570 tablet_bootstrap.cc:654] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:15.158171 18569 raft_consensus.cc:359] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.158824 18569 raft_consensus.cc:385] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.159087 18569 raft_consensus.cc:740] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.159686 18569 consensus_queue.cc:260] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.160527 18962 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:15.160936 18962 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:15.162737 18962 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:15.165947 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:15.167038 18377 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.173749 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:15.179939 18265 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:15.180625 18964 raft_consensus.cc:2749] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260204 08:59:15.184679 18878 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:15.185109 18878 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:15.186905 18878 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:15.191255 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:15.191987 18374 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:15.193872 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:15.194773 18448 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 0.
I20260204 08:59:15.199501 18488 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:15.200229 18977 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:15.200590 18977 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:15.200909 18977 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.195636 18569 ts_tablet_manager.cc:1434] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.040s user 0.005s sys 0.000s
I20260204 08:59:15.202610 18569 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:15.213726 18977 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:15.218091 18569 tablet_bootstrap.cc:654] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:15.227413 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:15.228050 18374 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.234169 18977 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:15.242375 18570 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4: No bootstrap required, opened a new log
I20260204 08:59:15.242911 18570 ts_tablet_manager.cc:1403] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent bootstrapping tablet: real 0.092s user 0.029s sys 0.060s
I20260204 08:59:15.245738 18570 raft_consensus.cc:359] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.246451 18570 raft_consensus.cc:385] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.246749 18570 raft_consensus.cc:740] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.247424 18570 consensus_queue.cc:260] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.249121 18570 ts_tablet_manager.cc:1434] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:59:15.256541 18671 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:15.257015 18671 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.257390 18374 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:15.258698 18488 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:15.260337 18878 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:15.260541 18671 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:15.261884 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:15.262583 18451 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:15.263470 18878 raft_consensus.cc:697] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:15.264283 18878 consensus_queue.cc:237] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:15.265064 18569 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:15.265302 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:15.265558 18569 ts_tablet_manager.cc:1403] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.010s
I20260204 08:59:15.265865 18448 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.267506 18265 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:15.268448 18569 raft_consensus.cc:359] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.269202 18962 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:15.269605 18962 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:15.269987 18962 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.271204 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:15.271799 18522 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 0.
I20260204 08:59:15.269212 18569 raft_consensus.cc:385] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.273375 18569 raft_consensus.cc:740] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.274040 18569 consensus_queue.cc:260] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.281176 18962 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.283870 18448 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:15.285431 18569 ts_tablet_manager.cc:1434] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260204 08:59:15.287005 18569 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:15.287766 18198 catalog_manager.cc:5654] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 1 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:15.292827 18569 tablet_bootstrap.cc:654] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Neither blocks nor log segments found. Creating new log.
I20260204 08:59:15.293725 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:15.294261 18448 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.296978 18962 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:15.301003 18569 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: No bootstrap required, opened a new log
I20260204 08:59:15.301537 18569 ts_tablet_manager.cc:1403] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260204 08:59:15.304128 18569 raft_consensus.cc:359] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.304442 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:15.304867 18569 raft_consensus.cc:385] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 08:59:15.304963 18522 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.305217 18569 raft_consensus.cc:740] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:15.305939 18569 consensus_queue.cc:260] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.307520 18569 ts_tablet_manager.cc:1434] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:59:15.310317 18522 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:15.313936 18448 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:15.314769 18265 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:15.315543 18962 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:15.316157 18962 raft_consensus.cc:697] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:15.316931 18962 consensus_queue.cc:237] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:15.324440 18197 catalog_manager.cc:5654] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 1 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:15.342435 18974 consensus_queue.cc:1048] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.353068 18977 consensus_queue.cc:1048] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.378242 18972 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:15.378688 18972 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.380203 18972 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:15.380863 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:15.381057 18296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:15.381390 18522 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:15.381611 18296 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 0.
I20260204 08:59:15.382182 18340 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:15.382855 18972 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 08:59:15.383189 18972 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:15.383510 18972 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.388742 18972 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.390455 18972 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:15.390779 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:15.391140 18296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:15.391456 18522 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.391631 18296 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.395685 18522 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:15.396016 18296 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:15.396495 18340 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:15.397204 18972 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 08:59:15.397559 18972 raft_consensus.cc:697] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:15.398221 18972 consensus_queue.cc:237] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:15.406563 18197 catalog_manager.cc:5654] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 1 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:15.427852 18962 consensus_queue.cc:1048] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.429797 18296 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.440796 18962 consensus_queue.cc:1048] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.462390 18977 consensus_queue.cc:1048] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.472731 18974 consensus_queue.cc:1048] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.489221 18374 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.532505 18974 consensus_queue.cc:1048] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.542807 18296 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 0 FOLLOWER]: Advancing to term 1
I20260204 08:59:15.554121 18977 consensus_queue.cc:1048] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.694765 18975 consensus_queue.cc:1048] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.705180 18668 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.707551 18975 consensus_queue.cc:1048] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260204 08:59:15.718652 18668 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.862396 18972 consensus_queue.cc:1048] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:15.884393 18972 consensus_queue.cc:1048] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 08:59:17.260812 15375 tablet_server.cc:178] TabletServer@127.15.3.193:0 shutting down...
W20260204 08:59:17.276465 18343 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 81 similar messages]
W20260204 08:59:17.280651 18343 consensus_peers.cc:597] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.290159 15375 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 08:59:17.291209 15375 tablet_replica.cc:333] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.291967 15375 raft_consensus.cc:2243] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.292392 15375 raft_consensus.cc:2272] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.296402 15375 tablet_replica.cc:333] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.297212 15375 raft_consensus.cc:2243] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
W20260204 08:59:17.297686 18491 consensus_peers.cc:597] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.298497 15375 raft_consensus.cc:2272] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:17.299674 18491 consensus_peers.cc:597] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.300253 15375 tablet_replica.cc:333] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.300858 15375 raft_consensus.cc:2243] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.301224 15375 raft_consensus.cc:2272] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.302793 15375 tablet_replica.cc:333] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.303308 15375 raft_consensus.cc:2243] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.303982 15375 raft_consensus.cc:2272] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.305474 15375 tablet_replica.cc:333] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.306013 15375 raft_consensus.cc:2243] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.306491 15375 raft_consensus.cc:2272] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.308362 15375 tablet_replica.cc:333] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.309059 15375 raft_consensus.cc:2243] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.309686 15375 raft_consensus.cc:2272] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.311118 15375 tablet_replica.cc:333] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.311595 15375 raft_consensus.cc:2243] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.312224 15375 raft_consensus.cc:2272] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.313632 15375 tablet_replica.cc:333] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.314108 15375 raft_consensus.cc:2243] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.314417 15375 raft_consensus.cc:2272] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.315907 15375 tablet_replica.cc:333] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.316414 15375 raft_consensus.cc:2243] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.316772 15375 raft_consensus.cc:2272] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.318208 15375 tablet_replica.cc:333] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.318727 15375 raft_consensus.cc:2243] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.319072 15375 raft_consensus.cc:2272] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.320628 15375 tablet_replica.cc:333] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.321135 15375 raft_consensus.cc:2243] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.321483 15375 raft_consensus.cc:2272] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.323014 15375 tablet_replica.cc:333] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.323539 15375 raft_consensus.cc:2243] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.323958 15375 raft_consensus.cc:2272] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.325371 15375 tablet_replica.cc:333] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.325872 15375 raft_consensus.cc:2243] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.326519 15375 raft_consensus.cc:2272] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.328009 15375 tablet_replica.cc:333] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.328491 15375 raft_consensus.cc:2243] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.328830 15375 raft_consensus.cc:2272] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.330271 15375 tablet_replica.cc:333] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.330770 15375 raft_consensus.cc:2243] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.331116 15375 raft_consensus.cc:2272] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.332649 15375 tablet_replica.cc:333] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.333117 15375 raft_consensus.cc:2243] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.333465 15375 raft_consensus.cc:2272] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.334946 15375 tablet_replica.cc:333] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.335415 15375 raft_consensus.cc:2243] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.336148 15375 raft_consensus.cc:2272] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.337677 15375 tablet_replica.cc:333] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.338152 15375 raft_consensus.cc:2243] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.338521 15375 raft_consensus.cc:2272] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.340040 15375 tablet_replica.cc:333] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.340565 15375 raft_consensus.cc:2243] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.340909 15375 raft_consensus.cc:2272] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.342657 15375 tablet_replica.cc:333] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.343302 15375 raft_consensus.cc:2243] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.343842 15375 raft_consensus.cc:2272] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.345865 15375 tablet_replica.cc:333] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.346570 15375 raft_consensus.cc:2243] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.347008 15375 raft_consensus.cc:2272] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.349010 15375 tablet_replica.cc:333] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.349690 15375 raft_consensus.cc:2243] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.350121 15375 raft_consensus.cc:2272] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.352279 15375 tablet_replica.cc:333] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.352944 15375 raft_consensus.cc:2243] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.353792 15375 raft_consensus.cc:2272] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.355897 15375 tablet_replica.cc:333] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.356614 15375 raft_consensus.cc:2243] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.356993 15375 raft_consensus.cc:2272] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.358461 15375 tablet_replica.cc:333] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.358930 15375 raft_consensus.cc:2243] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.359570 15375 raft_consensus.cc:2272] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.361083 15375 tablet_replica.cc:333] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.361564 15375 raft_consensus.cc:2243] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.362169 15375 raft_consensus.cc:2272] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.363613 15375 tablet_replica.cc:333] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.364120 15375 raft_consensus.cc:2243] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.364461 15375 raft_consensus.cc:2272] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.366109 15375 tablet_replica.cc:333] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.366756 15375 raft_consensus.cc:2243] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.367194 15375 raft_consensus.cc:2272] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:17.368450 18343 consensus_peers.cc:597] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.369206 15375 tablet_replica.cc:333] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.369779 15375 raft_consensus.cc:2243] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.370220 15375 raft_consensus.cc:2272] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.371956 15375 tablet_replica.cc:333] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.372445 15375 raft_consensus.cc:2243] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.372792 15375 raft_consensus.cc:2272] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.374317 15375 tablet_replica.cc:333] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.374789 15375 raft_consensus.cc:2243] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.375134 15375 raft_consensus.cc:2272] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.376607 15375 tablet_replica.cc:333] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.377063 15375 raft_consensus.cc:2243] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.377388 15375 raft_consensus.cc:2272] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.378805 15375 tablet_replica.cc:333] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.379272 15375 raft_consensus.cc:2243] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.379907 15375 raft_consensus.cc:2272] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.381371 15375 tablet_replica.cc:333] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.381852 15375 raft_consensus.cc:2243] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.382332 15375 raft_consensus.cc:2272] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.384042 15375 tablet_replica.cc:333] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.384696 15375 raft_consensus.cc:2243] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.385409 15375 raft_consensus.cc:2272] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.386994 15375 tablet_replica.cc:333] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.387459 15375 raft_consensus.cc:2243] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.387843 15375 raft_consensus.cc:2272] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.389333 15375 tablet_replica.cc:333] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.389808 15375 raft_consensus.cc:2243] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.390461 15375 raft_consensus.cc:2272] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.392212 15375 tablet_replica.cc:333] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.392809 15375 raft_consensus.cc:2243] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.393668 15375 raft_consensus.cc:2272] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.395401 15375 tablet_replica.cc:333] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.395897 15375 raft_consensus.cc:2243] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.396270 15375 raft_consensus.cc:2272] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.398170 15375 tablet_replica.cc:333] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.398782 15375 raft_consensus.cc:2243] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.399168 15375 raft_consensus.cc:2272] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:17.400075 18417 consensus_peers.cc:597] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.401003 15375 tablet_replica.cc:333] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.401530 15375 raft_consensus.cc:2243] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.401859 15375 raft_consensus.cc:2272] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.403829 15375 tablet_replica.cc:333] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
W20260204 08:59:17.404035 18343 consensus_peers.cc:597] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.404497 15375 raft_consensus.cc:2243] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.404898 15375 raft_consensus.cc:2272] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.406617 15375 tablet_replica.cc:333] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.407075 15375 raft_consensus.cc:2243] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 LEADER]: Raft consensus shutting down.
I20260204 08:59:17.407754 15375 raft_consensus.cc:2272] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.409648 15375 tablet_replica.cc:333] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.410188 15375 raft_consensus.cc:2243] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.410508 15375 raft_consensus.cc:2272] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 08:59:17.412122 15375 tablet_replica.cc:333] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: stopping tablet replica
I20260204 08:59:17.412508 15375 raft_consensus.cc:2243] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 08:59:17.412839 15375 raft_consensus.cc:2272] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Raft consensus is shut down!
W20260204 08:59:17.435923 18417 consensus_peers.cc:597] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.452647 18343 consensus_peers.cc:597] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.460074 18417 consensus_peers.cc:597] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.471105 15375 tablet_server.cc:195] TabletServer@127.15.3.193:0 shutdown complete.
W20260204 08:59:17.479910 18491 consensus_peers.cc:597] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.505321 18491 consensus_peers.cc:597] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.509474 18491 consensus_peers.cc:597] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.523018 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 08:59:17.530789 19041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:17.531877 19040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 08:59:17.534641 18417 consensus_peers.cc:597] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.534970 15375 server_base.cc:1060] running on GCE node
W20260204 08:59:17.535533 19044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 08:59:17.538035 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 08:59:17.538242 15375 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 08:59:17.538374 15375 hybrid_clock.cc:648] HybridClock initialized: now 1770195557538364 us; error 0 us; skew 500 ppm
I20260204 08:59:17.538836 15375 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260204 08:59:17.541335 15375 webserver.cc:492] Webserver started at http://127.15.3.193:32833/ using document root <none> and password file <none>
I20260204 08:59:17.541760 15375 fs_manager.cc:362] Metadata directory not provided
I20260204 08:59:17.541920 15375 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260204 08:59:17.545766 15375 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260204 08:59:17.553126 19049 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 08:59:17.553848 15375 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.005s sys 0.000s
I20260204 08:59:17.554150 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
uuid: "354a648f08a44b98a7f93d74b0ea93ab"
format_stamp: "Formatted at 2026-02-04 08:59:06 on dist-test-slave-3tf0"
I20260204 08:59:17.554493 15375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdz1hBO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770195438343508-15375-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 08:59:17.571961 15375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 08:59:17.573263 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 08:59:17.575183 15375 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260204 08:59:17.589615 18417 consensus_peers.cc:597] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.592815 18417 consensus_peers.cc:597] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.594909 19057 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260204 08:59:17.598919 18491 consensus_peers.cc:597] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.604023 18491 consensus_peers.cc:597] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.605384 18343 consensus_peers.cc:597] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.620296 18417 consensus_peers.cc:597] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.623831 18491 consensus_peers.cc:597] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.626927 18491 consensus_peers.cc:597] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.717980 18491 consensus_peers.cc:597] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.723975 18491 consensus_peers.cc:597] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.734511 18417 consensus_peers.cc:597] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.751300 18343 consensus_peers.cc:597] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.777099 18343 consensus_peers.cc:597] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.778887 18417 consensus_peers.cc:597] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.780915 18491 consensus_peers.cc:597] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.784183 18343 consensus_peers.cc:597] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.789717 18343 consensus_peers.cc:597] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260204 08:59:17.814749 18417 consensus_peers.cc:597] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Status: Network error: Client connection negotiation failed: client connection to 127.15.3.193:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:17.848204 15375 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260204 08:59:17.848614 15375 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.257s user 0.011s sys 0.001s
I20260204 08:59:17.848981 15375 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260204 08:59:17.853775 19057 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:17.864326 19057 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:17.864938 19057 tablet_bootstrap.cc:492] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:17.865368 19057 ts_tablet_manager.cc:1403] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.008s
I20260204 08:59:17.867033 19057 raft_consensus.cc:359] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:17.867524 19057 raft_consensus.cc:740] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:17.868131 19057 consensus_queue.cc:260] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:17.870275 19057 ts_tablet_manager.cc:1434] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260204 08:59:17.870854 19057 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:17.881016 19057 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:17.881711 19057 tablet_bootstrap.cc:492] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:17.882191 19057 ts_tablet_manager.cc:1403] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260204 08:59:17.883767 19057 raft_consensus.cc:359] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:17.884194 19057 raft_consensus.cc:740] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:17.884701 19057 consensus_queue.cc:260] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:17.885979 19057 ts_tablet_manager.cc:1434] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:17.886533 19057 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:17.896756 19057 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:17.897420 19057 tablet_bootstrap.cc:492] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:17.897888 19057 ts_tablet_manager.cc:1403] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260204 08:59:17.899802 19057 raft_consensus.cc:359] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:17.900243 19057 raft_consensus.cc:740] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:17.900682 19057 consensus_queue.cc:260] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:17.902058 19057 ts_tablet_manager.cc:1434] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:17.902702 19057 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:17.914067 19057 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:17.914781 19057 tablet_bootstrap.cc:492] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:17.915295 19057 ts_tablet_manager.cc:1403] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260204 08:59:17.917284 19057 raft_consensus.cc:359] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:17.917887 19057 raft_consensus.cc:740] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:17.918556 19057 consensus_queue.cc:260] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:17.920396 19057 ts_tablet_manager.cc:1434] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260204 08:59:17.921094 19057 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:17.935099 19057 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:17.935876 19057 tablet_bootstrap.cc:492] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:17.936426 19057 ts_tablet_manager.cc:1403] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20260204 08:59:17.937875 19057 raft_consensus.cc:359] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:17.938333 19057 raft_consensus.cc:740] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:17.938824 19057 consensus_queue.cc:260] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:17.940230 19057 ts_tablet_manager.cc:1434] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:17.940917 19057 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:17.957878 19057 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:17.958596 19057 tablet_bootstrap.cc:492] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:17.959079 19057 ts_tablet_manager.cc:1403] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.000s
I20260204 08:59:17.960947 19057 raft_consensus.cc:359] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:17.961453 19057 raft_consensus.cc:740] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:17.962059 19057 consensus_queue.cc:260] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:17.963469 19057 ts_tablet_manager.cc:1434] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:17.964076 19057 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:17.977524 19057 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:17.978332 19057 tablet_bootstrap.cc:492] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:17.978883 19057 ts_tablet_manager.cc:1403] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.004s
I20260204 08:59:17.980927 19057 raft_consensus.cc:359] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:17.981552 19057 raft_consensus.cc:740] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:17.982204 19057 consensus_queue.cc:260] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:17.984136 19057 ts_tablet_manager.cc:1434] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260204 08:59:17.984849 19057 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.032368 19057 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.033041 19057 tablet_bootstrap.cc:492] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.033509 19057 ts_tablet_manager.cc:1403] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.049s user 0.025s sys 0.019s
I20260204 08:59:18.035060 19057 raft_consensus.cc:359] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.035540 19057 raft_consensus.cc:740] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.036087 19057 consensus_queue.cc:260] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.037590 19057 ts_tablet_manager.cc:1434] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:18.038244 19057 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.052974 15375 ts_tablet_manager.cc:616] Registered 45 tablets
I20260204 08:59:18.053272 15375 ts_tablet_manager.cc:595] Time spent register tablets: real 0.204s user 0.192s sys 0.003s
I20260204 08:59:18.054282 19057 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.055200 19057 tablet_bootstrap.cc:492] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.055833 19057 ts_tablet_manager.cc:1403] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.018s user 0.016s sys 0.000s
I20260204 08:59:18.057649 19057 raft_consensus.cc:359] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.058229 19057 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.058845 19057 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.060662 19057 ts_tablet_manager.cc:1434] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:18.061342 19057 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.079412 19057 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.080312 19057 tablet_bootstrap.cc:492] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.080868 19057 ts_tablet_manager.cc:1403] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.004s
I20260204 08:59:18.082706 19057 raft_consensus.cc:359] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.083338 19057 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.084025 19057 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.085907 19057 ts_tablet_manager.cc:1434] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:59:18.086635 19057 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.098027 19057 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.099104 19057 tablet_bootstrap.cc:492] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.099727 19057 ts_tablet_manager.cc:1403] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.013s user 0.013s sys 0.000s
I20260204 08:59:18.101229 19057 raft_consensus.cc:359] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.101670 19057 raft_consensus.cc:740] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.102173 19057 consensus_queue.cc:260] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.103665 19057 ts_tablet_manager.cc:1434] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20260204 08:59:18.104238 19057 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.116628 19057 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.117415 19057 tablet_bootstrap.cc:492] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.117995 19057 ts_tablet_manager.cc:1403] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260204 08:59:18.120167 19057 raft_consensus.cc:359] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.120832 19057 raft_consensus.cc:740] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.121556 19057 consensus_queue.cc:260] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.123337 19057 ts_tablet_manager.cc:1434] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260204 08:59:18.124131 19057 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.142711 19057 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.143373 19057 tablet_bootstrap.cc:492] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.143913 19057 ts_tablet_manager.cc:1403] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.020s user 0.019s sys 0.000s
I20260204 08:59:18.145557 19057 raft_consensus.cc:359] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.146114 19057 raft_consensus.cc:740] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.146736 19057 consensus_queue.cc:260] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.148586 19057 ts_tablet_manager.cc:1434] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:18.149331 19057 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.165459 15375 rpc_server.cc:307] RPC server started. Bound to: 127.15.3.193:33867
I20260204 08:59:18.165565 19135 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.3.193:33867 every 8 connection(s)
I20260204 08:59:18.168380 19057 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.169334 19057 tablet_bootstrap.cc:492] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.169983 19057 ts_tablet_manager.cc:1403] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.004s
I20260204 08:59:18.172284 19057 raft_consensus.cc:359] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.172895 19057 raft_consensus.cc:740] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.173583 19057 consensus_queue.cc:260] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.175299 19057 ts_tablet_manager.cc:1434] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260204 08:59:18.176059 19057 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.190618 19057 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.191484 19057 tablet_bootstrap.cc:492] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.192091 19057 ts_tablet_manager.cc:1403] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.004s
I20260204 08:59:18.194168 19057 raft_consensus.cc:359] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.194828 19057 raft_consensus.cc:740] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.195438 19057 consensus_queue.cc:260] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.197711 19057 ts_tablet_manager.cc:1434] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260204 08:59:18.198484 19057 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.254096 19057 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.254966 19057 tablet_bootstrap.cc:492] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.255539 19057 ts_tablet_manager.cc:1403] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.057s user 0.018s sys 0.016s
I20260204 08:59:18.257844 19057 raft_consensus.cc:359] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.258481 19057 raft_consensus.cc:740] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.259124 19057 consensus_queue.cc:260] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.261320 19057 ts_tablet_manager.cc:1434] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:59:18.262130 19057 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.319062 19136 heartbeater.cc:344] Connected to a master server at 127.15.3.254:37341
I20260204 08:59:18.319552 19136 heartbeater.cc:461] Registering TS with master...
I20260204 08:59:18.320475 19136 heartbeater.cc:507] Master 127.15.3.254:37341 requested a full tablet report, sending...
I20260204 08:59:18.321861 19057 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.322764 19057 tablet_bootstrap.cc:492] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.323436 19057 ts_tablet_manager.cc:1403] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.062s user 0.024s sys 0.028s
I20260204 08:59:18.334980 19057 raft_consensus.cc:359] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.335669 19057 raft_consensus.cc:740] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.336292 19057 consensus_queue.cc:260] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.338376 19057 ts_tablet_manager.cc:1434] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260204 08:59:18.339087 19057 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.341003 18198 ts_manager.cc:194] Re-registered known tserver with Master: 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.357843 19057 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.358557 19057 tablet_bootstrap.cc:492] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.359006 19057 ts_tablet_manager.cc:1403] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.004s
I20260204 08:59:18.360597 19057 raft_consensus.cc:359] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.361186 19057 raft_consensus.cc:740] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.361840 19057 consensus_queue.cc:260] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.363783 19057 ts_tablet_manager.cc:1434] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260204 08:59:18.364500 19057 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.369918 18878 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.370401 18878 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.372844 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:18.373142 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.372980 18878 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.373800 19107 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:18.375196 18491 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:18.375916 18878 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.376223 18878 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.376596 18878 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.384259 18878 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.386513 18878 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.386461 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:18.386909 19057 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.387313 18899 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.387816 19057 tablet_bootstrap.cc:492] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.387852 18899 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.388551 19057 ts_tablet_manager.cc:1403] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.004s
I20260204 08:59:18.389041 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.389616 19107 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.390775 19057 raft_consensus.cc:359] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.391424 19057 raft_consensus.cc:740] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.391944 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.392156 19057 consensus_queue.cc:260] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.395339 19057 ts_tablet_manager.cc:1434] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:59:18.396279 19057 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.400104 19107 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:18.401295 18491 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:18.401397 18899 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.402015 18878 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.402135 18198 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54546
I20260204 08:59:18.403235 18878 raft_consensus.cc:697] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:18.404356 18878 consensus_queue.cc:237] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.406982 19136 heartbeater.cc:499] Master 127.15.3.254:37341 was elected leader, sending a full tablet report...
I20260204 08:59:18.403451 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.408259 19106 raft_consensus.cc:2468] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:18.409373 18417 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:18.410069 18899 raft_consensus.cc:2804] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.410419 18899 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.410750 18899 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.415443 19060 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.415969 19060 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.417831 19060 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.419315 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:18.420645 18491 leader_election.cc:343] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.421522 18899 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.422887 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:18.427627 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:18.429049 18488 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:18.429440 18899 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.430205 19034 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.432014 18975 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:18.432047 19034 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.434059 19034 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.436326 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:18.437836 18343 leader_election.cc:343] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.438797 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.441000 18340 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:18.443907 19059 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:18.430301 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.446715 19106 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.450551 19057 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.451408 19057 tablet_bootstrap.cc:492] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.452019 19057 ts_tablet_manager.cc:1403] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.056s user 0.017s sys 0.028s
I20260204 08:59:18.454893 19057 raft_consensus.cc:359] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.454742 18196 catalog_manager.cc:5654] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:18.455528 19057 raft_consensus.cc:740] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.456377 19106 raft_consensus.cc:2468] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:18.456182 19057 consensus_queue.cc:260] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.457573 18417 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:18.458119 18899 raft_consensus.cc:2804] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.458269 19057 ts_tablet_manager.cc:1434] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260204 08:59:18.459086 19057 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.459231 18899 raft_consensus.cc:697] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:18.460141 18899 consensus_queue.cc:237] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.473011 18975 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.473239 19034 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.473542 18975 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.473747 19034 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.475227 18975 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.477218 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:18.478700 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.475486 19034 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.479302 19107 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:18.479904 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.480504 19106 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:18.480723 18491 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:18.481455 19060 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.481812 19060 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.482131 19060 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.482239 18343 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:18.483018 19034 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.483353 19034 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.484758 19034 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.485833 19057 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.486797 19057 tablet_bootstrap.cc:492] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.487430 19057 ts_tablet_manager.cc:1403] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.000s
I20260204 08:59:18.489141 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.489730 19057 raft_consensus.cc:359] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.490432 19057 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.491075 19057 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.493431 19057 ts_tablet_manager.cc:1434] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260204 08:59:18.494217 19057 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.498440 19034 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.501039 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:18.502039 19060 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.505106 19034 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.505853 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.506364 19107 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.510324 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:18.513646 19107 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:18.514854 18343 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:18.515904 19034 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.518630 19060 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.520228 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.521363 19107 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.517112 19034 raft_consensus.cc:697] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:18.524426 19034 consensus_queue.cc:237] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.527637 18198 catalog_manager.cc:5654] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:18.531015 19057 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.531935 19057 tablet_bootstrap.cc:492] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.532553 19057 ts_tablet_manager.cc:1403] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.039s user 0.023s sys 0.010s
I20260204 08:59:18.534566 19057 raft_consensus.cc:359] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.535161 19057 raft_consensus.cc:740] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.535705 19057 consensus_queue.cc:260] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.537671 19057 ts_tablet_manager.cc:1434] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260204 08:59:18.540131 19057 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.541075 19107 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:18.545886 18491 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:18.551844 19034 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.552469 19034 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.551928 19060 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.554081 19060 raft_consensus.cc:697] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:18.554289 19034 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.554903 19060 consensus_queue.cc:237] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.555708 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:18.557150 18343 leader_election.cc:343] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.559743 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.561091 18899 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.561403 18340 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:18.561586 18899 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.562357 19034 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:18.563284 18899 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.564625 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.565400 19109 raft_consensus.cc:2393] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 2: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:18.560393 18197 catalog_manager.cc:5654] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:18.568480 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.571298 18414 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:18.572757 19064 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.574498 19060 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.575009 19060 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.576831 19060 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.580147 19064 raft_consensus.cc:2749] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:18.580619 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.589193 18374 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:18.582275 19060 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.589505 18197 catalog_manager.cc:5654] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:18.590206 19060 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.592067 19060 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.583226 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.592089 19057 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.593089 18488 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:18.593525 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.594125 18377 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:18.585981 19035 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.594939 19035 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.596966 18975 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.597347 18975 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.597448 19035 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:18.597699 18975 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.600176 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:18.601485 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.601184 19057 tablet_bootstrap.cc:492] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.602259 19107 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:18.602826 19057 ts_tablet_manager.cc:1403] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.063s user 0.015s sys 0.017s
I20260204 08:59:18.603243 18343 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:18.603699 19061 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.604014 19034 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.604421 19034 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.604162 19061 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.604775 19034 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.605070 19057 raft_consensus.cc:359] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.601397 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.605722 19057 raft_consensus.cc:740] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.606457 19057 consensus_queue.cc:260] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.608537 19057 ts_tablet_manager.cc:1434] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260204 08:59:18.606880 18975 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:18.605304 18491 leader_election.cc:343] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.610256 18975 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.610793 19057 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.611378 19034 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:18.613323 18491 leader_election.cc:343] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.613876 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.619861 19107 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.614674 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.620661 19064 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.621201 19064 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.614637 19034 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:18.616403 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:18.617167 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:18.622690 18374 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.623051 19064 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.625500 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.625766 19034 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.626016 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.626978 19057 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260204 08:59:18.627152 18417 leader_election.cc:343] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.627844 19057 tablet_bootstrap.cc:492] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.628049 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.628461 19057 ts_tablet_manager.cc:1403] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.007s
I20260204 08:59:18.629082 18523 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:18.630204 18414 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:18.631000 18374 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:18.619285 19061 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.632248 19034 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.635139 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.635833 19109 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:18.636758 18343 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:18.631176 19064 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.637351 19064 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.637619 19034 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.637694 19064 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.638002 19035 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.638377 19035 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.638722 19035 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.639801 19057 raft_consensus.cc:359] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.640589 19057 raft_consensus.cc:740] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.641216 19057 consensus_queue.cc:260] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:18.633496 18491 leader_election.cc:343] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
W20260204 08:59:18.643020 18491 leader_election.cc:343] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.643355 19057 ts_tablet_manager.cc:1434] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260204 08:59:18.633769 18488 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:18.644476 19057 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.645084 18975 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.645458 18975 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.645758 18975 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.648500 19060 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.648984 19060 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.650218 19064 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.650718 19060 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.652058 19064 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.653074 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.653388 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:18.653903 18523 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
W20260204 08:59:18.654239 18417 leader_election.cc:343] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.657044 18488 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:18.660629 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.662199 18878 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.662674 18878 raft_consensus.cc:697] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:18.662590 18975 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.663450 18878 consensus_queue.cc:237] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.664562 18975 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.666723 18523 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:18.667939 18414 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:18.668924 18976 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.669692 18976 raft_consensus.cc:697] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:18.670641 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.670519 18976 consensus_queue.cc:237] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.672057 19034 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.672595 19034 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.673960 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.675547 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.675666 19034 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:18.676795 18343 leader_election.cc:343] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.690562 18197 catalog_manager.cc:5654] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:18.696473 18976 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.697053 18976 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.698943 18976 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.701442 19057 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.705220 19057 tablet_bootstrap.cc:492] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.706596 19057 ts_tablet_manager.cc:1403] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.063s user 0.026s sys 0.013s
I20260204 08:59:18.671985 19106 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:18.704111 19060 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.705060 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.708132 19108 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:18.707995 19060 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.709378 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.710772 18417 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:18.711521 18899 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.711550 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.711983 18899 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.712340 19060 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.712350 18899 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.713097 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.712400 19057 raft_consensus.cc:359] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.713742 18523 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:18.714003 19057 raft_consensus.cc:740] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.715583 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:18.716132 18374 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.716697 19057 consensus_queue.cc:260] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.719041 19057 ts_tablet_manager.cc:1434] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260204 08:59:18.721038 19057 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.722322 19166 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.632171 19107 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:18.724116 18374 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:18.727772 19165 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.722407 18899 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.729409 18488 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:18.748975 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.749781 19108 raft_consensus.cc:2393] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 2: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:18.729483 19166 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.750847 19062 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:18.747762 19165 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.729984 18976 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.735191 19064 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.752367 19064 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.752184 18976 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.754206 19064 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.755084 19166 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:18.754423 18976 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.757331 19165 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:18.758280 19165 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.758762 19165 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.727573 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.760471 19165 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:18.760388 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:18.745607 18491 leader_election.cc:343] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:18.762069 18491 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:18.762342 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.763732 19106 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:18.761157 19108 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.763835 18878 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.764451 18878 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.764808 18878 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.765033 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.765296 18417 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:18.765604 19106 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:18.762967 18488 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:18.766960 19061 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.767405 19061 raft_consensus.cc:697] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:18.768222 19061 consensus_queue.cc:237] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.770164 18197 catalog_manager.cc:5654] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:18.763374 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.773622 19060 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.774156 19060 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:18.775029 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 59321.5us
I20260204 08:59:18.776759 18976 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.777129 18976 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.777456 18976 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.778998 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:18.749675 18899 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.784960 18976 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.786773 18899 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.787245 18899 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.787477 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.788046 19106 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.788235 19060 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.789562 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.793084 18899 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.757177 19035 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.794397 19106 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:18.795130 19035 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.797024 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.797823 19109 raft_consensus.cc:2393] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 2: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:18.797739 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.798367 18377 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:18.798898 18417 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:18.799750 18417 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:18.800766 19170 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.800808 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:18.801385 18377 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.801767 19107 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:18.801406 19064 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.803546 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:18.805132 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:18.805703 18450 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:18.805838 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:18.806685 18448 raft_consensus.cc:2393] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 2: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:18.806959 18491 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:18.807947 19060 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.809007 18340 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:18.809041 18975 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.810405 18975 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.810905 19064 raft_consensus.cc:2749] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:18.811880 18417 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:18.812017 18975 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.801441 19170 raft_consensus.cc:697] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:18.808149 19035 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.813800 19170 consensus_queue.cc:237] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.814605 19035 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.815618 18377 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:18.816644 19035 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.817409 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.818004 19106 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:18.818367 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.818912 18376 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:18.819623 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.820214 18377 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:18.815802 18899 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.820757 18899 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.821244 18899 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.822252 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:18.822808 18523 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.825210 19057 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.826107 19057 tablet_bootstrap.cc:492] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.826715 19057 ts_tablet_manager.cc:1403] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.106s user 0.021s sys 0.015s
I20260204 08:59:18.826581 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.827497 19107 raft_consensus.cc:2393] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 2: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:18.828058 18343 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:18.828907 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.829078 19057 raft_consensus.cc:359] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.829572 18523 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:18.829754 19057 raft_consensus.cc:740] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:18.830118 19165 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.830526 19057 consensus_queue.cc:260] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:18.831441 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.832119 18377 raft_consensus.cc:2393] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 2: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:18.832614 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.833194 19107 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:18.829427 18878 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.830554 19165 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.836303 19165 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.837615 19057 ts_tablet_manager.cc:1434] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260204 08:59:18.838373 19057 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.840843 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.841440 19107 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.844450 19165 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.841506 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:18.860738 18377 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.851981 18340 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:18.852157 19035 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.862078 19035 raft_consensus.cc:697] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:18.862870 19035 consensus_queue.cc:237] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.863345 18340 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:18.864063 19059 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:18.864411 19059 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.864738 19059 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.865679 19034 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.866161 19034 raft_consensus.cc:697] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:18.866957 19034 consensus_queue.cc:237] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.871966 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:18.872820 18523 raft_consensus.cc:2393] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 2: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:18.873236 19165 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:18.856599 18976 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.874116 18899 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.875788 18899 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.877517 18377 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:18.878079 19059 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:18.860035 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 47380.4us
I20260204 08:59:18.835768 18878 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.860026 18491 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:18.880913 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.880636 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:18.881498 19106 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.881747 18523 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.881932 19061 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.814339 19060 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260204 08:59:18.884788 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 65641us
I20260204 08:59:18.889782 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:18.890394 18377 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.892160 19059 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:18.892891 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 64921.9us
I20260204 08:59:18.906730 18343 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:18.867076 19108 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:18.913146 19107 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:18.913982 18523 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:18.913796 18199 catalog_manager.cc:5654] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:18.918038 19061 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:18.919430 18198 catalog_manager.cc:5654] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:18.922374 18343 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:18.888409 18488 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:18.894505 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:18.900354 18414 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:18.923419 18451 raft_consensus.cc:2393] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 2: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:18.923592 18899 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.924062 18899 raft_consensus.cc:697] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:18.902762 18377 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:18.924746 18899 consensus_queue.cc:237] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.926126 18975 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.927004 19035 raft_consensus.cc:2749] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:18.927759 18340 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:18.881599 18491 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 08:59:18.931228 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 49725.8us
I20260204 08:59:18.903571 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:18.900250 19170 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:18.932060 18376 raft_consensus.cc:2393] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 2: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:18.931932 19170 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.932919 18878 raft_consensus.cc:2764] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260204 08:59:18.933808 19170 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:18.905320 19106 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:18.934957 19057 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:18.936545 19106 raft_consensus.cc:1275] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:18.937058 18417 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:18.938604 19062 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:18.939205 19165 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.939745 19165 raft_consensus.cc:697] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:18.940526 19165 consensus_queue.cc:237] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.941406 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:18.942246 19177 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:18.942778 19177 raft_consensus.cc:697] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:18.943552 19177 consensus_queue.cc:237] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.944614 19057 tablet_bootstrap.cc:492] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:18.945302 19057 ts_tablet_manager.cc:1403] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.107s user 0.042s sys 0.027s
I20260204 08:59:18.939920 19034 raft_consensus.cc:2764] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260204 08:59:18.947746 18975 raft_consensus.cc:697] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:18.947196 18199 catalog_manager.cc:5654] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:18.948885 18975 consensus_queue.cc:237] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:18.949771 18199 catalog_manager.cc:5654] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:18.952276 19108 raft_consensus.cc:1275] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:18.953855 19060 consensus_queue.cc:1048] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:18.957684 18523 raft_consensus.cc:1275] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:18.958616 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.959470 19106 raft_consensus.cc:2393] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 2: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:18.961516 18417 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:18.961630 18899 consensus_queue.cc:1048] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:18.962607 19170 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.947530 19057 raft_consensus.cc:359] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.968652 19057 raft_consensus.cc:740] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
W20260204 08:59:18.971200 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 48897.1us
I20260204 08:59:18.974918 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:18.975518 19106 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:18.974198 19057 consensus_queue.cc:260] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:18.984930 19057 ts_tablet_manager.cc:1434] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260204 08:59:18.985911 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:18.987663 19105 raft_consensus.cc:2393] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 2: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:18.991154 19057 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:18.986404 19170 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:19.002804 18198 catalog_manager.cc:5654] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:18.997779 18199 catalog_manager.cc:5654] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:19.006659 18198 catalog_manager.cc:5654] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:19.007591 19105 raft_consensus.cc:1275] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.008378 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:19.009209 19177 consensus_queue.cc:1048] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.013023 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:19.013772 19105 raft_consensus.cc:2393] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 2: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:19.052392 19057 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.053308 19057 tablet_bootstrap.cc:492] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.053871 19057 ts_tablet_manager.cc:1403] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.064s user 0.013s sys 0.003s
I20260204 08:59:19.056902 18343 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:19.058576 19057 raft_consensus.cc:359] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.058837 18451 raft_consensus.cc:1275] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.059122 19057 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.059767 19057 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.061218 18451 raft_consensus.cc:1275] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.061578 19057 ts_tablet_manager.cc:1434] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260204 08:59:19.062216 19057 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.065486 19106 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:19.066542 19034 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260204 08:59:19.070298 18343 leader_election.cc:343] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260204 08:59:19.071156 18343 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:19.071949 19034 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:19.075875 19109 raft_consensus.cc:1275] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.077979 19034 consensus_queue.cc:1048] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.083326 19057 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.083827 18975 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.084347 19057 tablet_bootstrap.cc:492] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.085124 19057 ts_tablet_manager.cc:1403] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.004s
I20260204 08:59:19.085175 19060 consensus_queue.cc:1048] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.089303 19057 raft_consensus.cc:359] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.089967 19057 raft_consensus.cc:740] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.090723 19057 consensus_queue.cc:260] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.092864 19057 ts_tablet_manager.cc:1434] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
I20260204 08:59:19.093685 19057 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.101840 18199 catalog_manager.cc:5654] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:19.128470 18523 raft_consensus.cc:1275] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.131570 19165 consensus_queue.cc:1048] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.143049 19057 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.143999 19057 tablet_bootstrap.cc:492] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.144580 19057 ts_tablet_manager.cc:1403] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.051s user 0.034s sys 0.014s
I20260204 08:59:19.146924 19057 raft_consensus.cc:359] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.147555 19057 raft_consensus.cc:740] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.148202 19057 consensus_queue.cc:260] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.150316 19057 ts_tablet_manager.cc:1434] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:59:19.151015 19057 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.195168 19109 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:19.203148 19109 raft_consensus.cc:1275] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.205271 19177 consensus_queue.cc:1048] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.213198 19108 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:19.218044 19057 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.218976 19057 tablet_bootstrap.cc:492] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.219590 19057 ts_tablet_manager.cc:1403] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.069s user 0.024s sys 0.036s
I20260204 08:59:19.220299 18523 raft_consensus.cc:1275] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.221248 19108 raft_consensus.cc:1275] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.221627 19057 raft_consensus.cc:359] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:19.222384 19057 raft_consensus.cc:740] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.222932 19057 consensus_queue.cc:260] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:19.224972 19057 ts_tablet_manager.cc:1434] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260204 08:59:19.224778 19173 consensus_queue.cc:1048] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.225719 19057 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.226076 19177 consensus_queue.cc:1048] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.227789 18376 raft_consensus.cc:1275] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.233259 19173 consensus_queue.cc:1048] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.243343 19057 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.244242 19057 tablet_bootstrap.cc:492] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.244688 18451 raft_consensus.cc:1275] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.244916 19057 ts_tablet_manager.cc:1403] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
I20260204 08:59:19.247462 19057 raft_consensus.cc:359] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.248131 19057 raft_consensus.cc:740] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.248519 19059 consensus_queue.cc:1048] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.248739 19057 consensus_queue.cc:260] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.250347 19057 ts_tablet_manager.cc:1434] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260204 08:59:19.251187 19057 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.257782 19108 raft_consensus.cc:1275] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.258611 19109 raft_consensus.cc:1275] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.259523 18976 consensus_queue.cc:1048] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.260551 19059 consensus_queue.cc:1048] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.382951 19057 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.384912 19057 tablet_bootstrap.cc:492] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.378515 19106 raft_consensus.cc:1275] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260204 08:59:19.386679 18491 consensus_peers.cc:597] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:19.401265 18523 raft_consensus.cc:1275] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.403751 18376 raft_consensus.cc:1275] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.407085 18377 raft_consensus.cc:1275] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.408162 19166 consensus_queue.cc:1048] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.409760 18976 consensus_queue.cc:1048] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.386142 19057 ts_tablet_manager.cc:1403] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.135s user 0.033s sys 0.007s
I20260204 08:59:19.472633 19165 consensus_queue.cc:1048] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.485743 18523 raft_consensus.cc:1275] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.487195 19173 consensus_queue.cc:1048] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260204 08:59:19.498279 18374 raft_consensus.cc:1275] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.498957 18372 raft_consensus.cc:1275] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.503628 19109 raft_consensus.cc:1275] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.503743 18976 consensus_queue.cc:1048] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:19.505429 19060 consensus_queue.cc:1048] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.509447 19034 consensus_queue.cc:1048] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.529631 19057 raft_consensus.cc:359] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:19.530592 19057 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.531442 19057 consensus_queue.cc:260] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:19.533689 19057 ts_tablet_manager.cc:1434] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.051s user 0.006s sys 0.000s
I20260204 08:59:19.535220 19057 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.550292 18377 raft_consensus.cc:1275] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.564697 19109 raft_consensus.cc:1275] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260204 08:59:19.566462 18343 consensus_peers.cc:597] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260204 08:59:19.568706 19174 consensus_queue.cc:1048] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.597757 18899 consensus_queue.cc:1048] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.615864 19105 raft_consensus.cc:1275] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:19.655894 19175 consensus_queue.cc:1048] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260204 08:59:19.692382 19057 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.693807 19057 tablet_bootstrap.cc:492] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.694525 19057 ts_tablet_manager.cc:1403] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.160s user 0.021s sys 0.003s
I20260204 08:59:19.696382 19216 consensus_queue.cc:1048] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:19.712749 19057 raft_consensus.cc:359] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.713634 19057 raft_consensus.cc:740] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
W20260204 08:59:19.718091 18343 consensus_peers.cc:597] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260204 08:59:19.716450 19057 consensus_queue.cc:260] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.739274 19057 ts_tablet_manager.cc:1434] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.044s user 0.005s sys 0.000s
I20260204 08:59:19.746873 19057 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
W20260204 08:59:19.767438 18491 consensus_peers.cc:597] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260204 08:59:19.779677 19057 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.780639 19057 tablet_bootstrap.cc:492] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.781251 19057 ts_tablet_manager.cc:1403] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.035s user 0.016s sys 0.004s
I20260204 08:59:19.783516 19057 raft_consensus.cc:359] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:19.784212 19057 raft_consensus.cc:740] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.784770 19057 consensus_queue.cc:260] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:19.786715 19057 ts_tablet_manager.cc:1434] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:59:19.787729 19057 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.801819 19057 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.802418 19057 tablet_bootstrap.cc:492] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.802874 19057 ts_tablet_manager.cc:1403] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260204 08:59:19.804490 19057 raft_consensus.cc:359] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.804921 19057 raft_consensus.cc:740] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.805334 19057 consensus_queue.cc:260] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.806941 19057 ts_tablet_manager.cc:1434] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:19.808092 19057 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.820979 19057 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.821626 19057 tablet_bootstrap.cc:492] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.822094 19057 ts_tablet_manager.cc:1403] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260204 08:59:19.823812 19057 raft_consensus.cc:359] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.824424 19057 raft_consensus.cc:740] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.824970 19057 consensus_queue.cc:260] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.826995 19057 ts_tablet_manager.cc:1434] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:59:19.828500 19057 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.850828 19057 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.851605 19057 tablet_bootstrap.cc:492] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.852244 19057 ts_tablet_manager.cc:1403] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.008s
I20260204 08:59:19.854144 19057 raft_consensus.cc:359] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.854697 19057 raft_consensus.cc:740] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.855294 19057 consensus_queue.cc:260] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:19.857489 19057 ts_tablet_manager.cc:1434] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:59:19.859203 19057 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
W20260204 08:59:19.863853 18491 consensus_peers.cc:597] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 -> Peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867): Couldn't send request to peer 354a648f08a44b98a7f93d74b0ea93ab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260204 08:59:19.873099 19057 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.873792 19057 tablet_bootstrap.cc:492] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.874256 19057 ts_tablet_manager.cc:1403] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.001s
I20260204 08:59:19.876292 19057 raft_consensus.cc:359] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:19.876924 19057 raft_consensus.cc:740] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.877597 19057 consensus_queue.cc:260] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:19.879544 19057 ts_tablet_manager.cc:1434] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:59:19.880442 19057 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.893371 19057 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.894114 19057 tablet_bootstrap.cc:492] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.894673 19057 ts_tablet_manager.cc:1403] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260204 08:59:19.896859 19057 raft_consensus.cc:359] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.897501 19057 raft_consensus.cc:740] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.898120 19057 consensus_queue.cc:260] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.900275 19057 ts_tablet_manager.cc:1434] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260204 08:59:19.901057 19057 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.932490 19057 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.933261 19057 tablet_bootstrap.cc:492] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.933831 19057 ts_tablet_manager.cc:1403] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.015s
I20260204 08:59:19.936156 19057 raft_consensus.cc:359] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.936736 19057 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.937345 19057 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.939298 19057 ts_tablet_manager.cc:1434] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260204 08:59:19.940413 19057 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.947153 19108 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:19.968715 19057 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.969632 19057 tablet_bootstrap.cc:492] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.970177 19057 ts_tablet_manager.cc:1403] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.030s user 0.018s sys 0.005s
I20260204 08:59:19.972664 19057 raft_consensus.cc:359] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.973186 19057 raft_consensus.cc:740] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.973724 19057 consensus_queue.cc:260] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.976423 19057 ts_tablet_manager.cc:1434] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260204 08:59:19.977038 19057 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:19.992142 19057 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:19.993077 19057 tablet_bootstrap.cc:492] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:19.993706 19057 ts_tablet_manager.cc:1403] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20260204 08:59:19.995744 19057 raft_consensus.cc:359] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.996368 19057 raft_consensus.cc:740] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:19.997017 19057 consensus_queue.cc:260] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:19.998334 19057 ts_tablet_manager.cc:1434] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260204 08:59:19.999038 19057 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:20.010818 19057 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:20.011498 19057 tablet_bootstrap.cc:492] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:20.012042 19057 ts_tablet_manager.cc:1403] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20260204 08:59:20.013749 19057 raft_consensus.cc:359] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:20.014221 19057 raft_consensus.cc:740] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:20.014792 19057 consensus_queue.cc:260] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:20.016649 19057 ts_tablet_manager.cc:1434] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:20.017531 19057 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap starting.
I20260204 08:59:20.030675 19057 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 08:59:20.031500 19057 tablet_bootstrap.cc:492] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Bootstrap complete.
I20260204 08:59:20.032111 19057 ts_tablet_manager.cc:1403] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260204 08:59:20.033906 19057 raft_consensus.cc:359] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:20.034375 19057 raft_consensus.cc:740] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Initialized, Role: FOLLOWER
I20260204 08:59:20.034821 19057 consensus_queue.cc:260] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:20.036595 19057 ts_tablet_manager.cc:1434] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260204 08:59:20.207582 19109 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.172317 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:28.216727 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:28.217242 18522 raft_consensus.cc:606] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:28.219216 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:28.219606 18522 raft_consensus.cc:606] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:28.221747 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:28.222136 18522 raft_consensus.cc:606] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:28.224215 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5a8edc898e45413484df91b064f36114"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:28.224682 18522 raft_consensus.cc:606] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:28.226788 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:28.227253 18522 raft_consensus.cc:606] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:28.237865 18448 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:39098
I20260204 08:59:28.238404 18448 raft_consensus.cc:606] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:28.239432 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260204 08:59:28.240932 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:28.241580 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:28.461361 19249 raft_consensus.cc:993] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:28.461931 19249 raft_consensus.cc:1081] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:28.463748 18372 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45710
I20260204 08:59:28.464304 18372 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:28.464648 18372 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.470440 18372 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.472676 18372 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:28.474629 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:28.475242 18448 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.475853 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:28.476436 18524 raft_consensus.cc:3055] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:28.476715 18524 raft_consensus.cc:740] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:28.477478 18524 consensus_queue.cc:260] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.478677 18524 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.483633 18448 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:28.485023 18340 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:28.485790 19247 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:28.486267 19247 raft_consensus.cc:697] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:28.486466 18524 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:28.487097 19247 consensus_queue.cc:237] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.497501 18199 catalog_manager.cc:5654] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:28.569571 19248 raft_consensus.cc:993] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:28.570056 19249 raft_consensus.cc:1081] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:28.571419 19109 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5a8edc898e45413484df91b064f36114"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46704
I20260204 08:59:28.571849 19109 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:28.572096 19109 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.577102 19109 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:28.579156 19109 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:28.592159 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:28.592752 18448 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.594521 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:28.595137 18524 raft_consensus.cc:3055] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:28.595453 18524 raft_consensus.cc:740] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:28.596330 18524 consensus_queue.cc:260] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:28.597548 18524 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.597879 18448 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:28.599237 19050 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:28.600919 19261 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:28.603911 18524 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:28.605727 19261 raft_consensus.cc:697] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:28.606438 19261 consensus_queue.cc:237] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:28.615687 18199 catalog_manager.cc:5654] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:28.628083 19241 raft_consensus.cc:993] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:28.628489 19249 raft_consensus.cc:1081] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:28.629848 18372 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45710
I20260204 08:59:28.630261 18372 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:28.630594 18372 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.635206 18372 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.636400 18372 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:28.637027 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:28.637306 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:28.637578 18448 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.637828 18524 raft_consensus.cc:3055] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:28.638159 18524 raft_consensus.cc:740] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:28.638757 18524 consensus_queue.cc:260] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.639626 18524 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.641882 18448 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:28.642654 18340 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:28.643239 19245 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:28.643678 19245 raft_consensus.cc:697] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:28.644728 18524 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:28.644491 19245 consensus_queue.cc:237] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.655196 19241 raft_consensus.cc:993] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:28.655665 19241 raft_consensus.cc:1081] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:28.655081 18199 catalog_manager.cc:5654] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:28.656950 19109 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46704
I20260204 08:59:28.657457 19109 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:28.657835 19109 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.665256 19109 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:28.666538 19109 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:28.667240 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:28.667384 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:28.667774 18448 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.667907 18524 raft_consensus.cc:3055] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:28.668213 18524 raft_consensus.cc:740] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:28.668725 18524 consensus_queue.cc:260] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:28.669557 18524 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.672117 18448 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:28.673218 19050 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:28.673951 19261 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:28.674317 19261 raft_consensus.cc:697] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:28.674474 18524 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:28.675035 19261 consensus_queue.cc:237] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:28.683431 18199 catalog_manager.cc:5654] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:28.697432 19241 raft_consensus.cc:993] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:28.697785 19249 raft_consensus.cc:1081] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:28.698912 18372 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45710
I20260204 08:59:28.699271 18372 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:28.699479 18372 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.703497 18372 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.704938 18372 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:28.705499 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:28.705832 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:28.706086 18448 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.706362 18524 raft_consensus.cc:3055] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:28.706636 18524 raft_consensus.cc:740] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:28.707223 18524 consensus_queue.cc:260] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.708379 18524 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.712121 18448 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:28.712884 18340 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:28.713245 18524 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:28.713428 19247 raft_consensus.cc:2804] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:28.713927 19247 raft_consensus.cc:697] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:28.714658 19247 consensus_queue.cc:237] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.722978 18199 catalog_manager.cc:5654] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:28.752506 19242 raft_consensus.cc:993] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:28.753049 19170 raft_consensus.cc:1081] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:28.754227 18372 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45722
I20260204 08:59:28.754633 18372 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:28.754879 18372 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.759104 18372 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.760422 18372 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:28.761068 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:28.761395 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:28.761924 18524 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.761552 18448 raft_consensus.cc:3055] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:28.762491 18448 raft_consensus.cc:740] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:28.763237 18448 consensus_queue.cc:260] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.764305 18448 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:28.766718 18524 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:28.767531 18340 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:28.768234 19245 raft_consensus.cc:2804] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:28.768657 19245 raft_consensus.cc:697] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:28.768694 18448 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:28.769443 19245 consensus_queue.cc:237] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:28.778497 18199 catalog_manager.cc:5654] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:28.957490 18524 raft_consensus.cc:1275] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:28.958505 19247 consensus_queue.cc:1048] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:28.983072 18451 raft_consensus.cc:1275] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:28.985260 19245 consensus_queue.cc:1048] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.082840 18451 raft_consensus.cc:1275] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.083990 19261 consensus_queue.cc:1048] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.086308 18524 raft_consensus.cc:1275] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.087567 19261 consensus_queue.cc:1048] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.088272 18524 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.089511 19273 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.120975 18521 raft_consensus.cc:1275] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.122778 19261 consensus_queue.cc:1048] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.132040 18451 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.133445 19273 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.146087 18448 raft_consensus.cc:1275] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.147560 19262 consensus_queue.cc:1048] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.221635 18521 raft_consensus.cc:1275] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.222729 19273 consensus_queue.cc:1048] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.231391 18448 raft_consensus.cc:1275] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.232280 18451 raft_consensus.cc:1275] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.234097 19273 consensus_queue.cc:1048] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:29.235141 19271 consensus_queue.cc:1048] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.248394 18524 raft_consensus.cc:1275] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.253027 19247 consensus_queue.cc:1048] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:29.276834 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:29.322540 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:29.322992 18374 raft_consensus.cc:606] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:29.324978 18448 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:39098
I20260204 08:59:29.325362 18448 raft_consensus.cc:606] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:29.327327 18521 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:29.327894 18521 raft_consensus.cc:606] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:29.330350 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:29.330832 18374 raft_consensus.cc:606] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:29.332526 19249 raft_consensus.cc:993] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:29.332943 19248 raft_consensus.cc:1081] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:29.333105 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:29.333580 18374 raft_consensus.cc:606] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:29.334084 19108 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46704
I20260204 08:59:29.334563 19108 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:29.334798 19108 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.335477 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:29.336045 18374 raft_consensus.cc:606] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:29.339788 19108 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:29.342061 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:29.342329 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:29.342543 18448 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.342733 19247 raft_consensus.cc:993] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:29.342940 18521 raft_consensus.cc:3055] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:29.343237 19273 raft_consensus.cc:1081] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:29.343282 18521 raft_consensus.cc:740] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:29.344190 18521 consensus_queue.cc:260] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:29.344775 19109 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46720
I20260204 08:59:29.345300 18521 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.345369 19109 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:29.345865 19109 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.341390 19108 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:29.351119 18521 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:29.352023 19050 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:29.352691 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260204 08:59:29.352713 19280 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:29.353449 19280 raft_consensus.cc:697] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:29.354281 18448 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:29.354483 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:29.354220 19280 consensus_queue.cc:237] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:29.355270 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:29.352653 19109 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:29.368700 19109 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:29.373962 18198 catalog_manager.cc:5654] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:29.384701 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:29.385483 18451 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.386966 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:29.387563 18374 raft_consensus.cc:3055] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:29.387885 18374 raft_consensus.cc:740] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:29.388641 18374 consensus_queue.cc:260] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:29.389797 18374 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.397192 18374 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:29.398576 19050 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:29.400550 19280 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:29.401036 19280 raft_consensus.cc:697] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:29.401822 19280 consensus_queue.cc:237] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:29.406334 18451 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:29.422950 18198 catalog_manager.cc:5654] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:29.499243 19273 raft_consensus.cc:993] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:29.499727 19247 raft_consensus.cc:1081] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:29.501190 18451 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47922
I20260204 08:59:29.501768 18451 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:29.502095 18451 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:29.508728 18451 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:29.555498 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:29.566560 18372 raft_consensus.cc:3055] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:29.567144 18372 raft_consensus.cc:740] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:29.557008 18451 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:29.557852 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:29.568293 18521 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:29.571226 18372 consensus_queue.cc:260] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:29.573350 18372 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:29.592346 18372 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:29.593948 18521 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:29.594228 18414 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:29.595525 19289 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:29.596264 19289 raft_consensus.cc:697] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:29.597667 19289 consensus_queue.cc:237] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:29.628932 18198 catalog_manager.cc:5654] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:29.713565 19245 raft_consensus.cc:993] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:29.714075 19271 raft_consensus.cc:1081] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:29.715325 18451 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47922
I20260204 08:59:29.715827 18451 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:29.716142 18451 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.725689 18451 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:29.727387 18451 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:29.728210 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:29.728250 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:29.728842 18372 raft_consensus.cc:3055] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:29.729108 18372 raft_consensus.cc:740] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:29.728960 18521 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.730144 18372 consensus_queue.cc:260] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:29.731353 18372 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.735598 18521 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:29.736686 18372 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:29.736698 18414 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:29.737546 19242 raft_consensus.cc:2804] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:29.737867 19242 raft_consensus.cc:697] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:29.738600 19242 consensus_queue.cc:237] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:29.750895 18451 raft_consensus.cc:1275] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.757944 19245 raft_consensus.cc:993] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:29.758447 19245 raft_consensus.cc:1081] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:29.761080 19108 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46720
I20260204 08:59:29.761647 19108 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:29.761972 19108 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:29.775215 19303 consensus_queue.cc:1048] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:29.782680 19108 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:29.784812 19108 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:29.786616 18198 catalog_manager.cc:5654] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:29.794720 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:29.795308 18522 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:29.802196 18522 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:29.811854 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:29.812508 18372 raft_consensus.cc:3055] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:29.812817 18372 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:29.813618 18372 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:29.821458 18372 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:29.830361 18372 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:29.831122 19242 raft_consensus.cc:993] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:29.832602 19289 raft_consensus.cc:1081] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:29.834981 18521 raft_consensus.cc:1275] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.835788 18451 raft_consensus.cc:1275] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.835441 19050 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:29.837749 19108 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46718
I20260204 08:59:29.838269 19108 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:29.838651 19108 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.841593 19301 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:29.843446 19301 raft_consensus.cc:697] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:29.844964 19301 consensus_queue.cc:237] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:29.848073 19280 consensus_queue.cc:1048] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:29.851445 19262 consensus_queue.cc:1048] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:29.858096 19108 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:29.860126 19108 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:29.862134 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:29.862664 18448 raft_consensus.cc:3055] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:29.862915 18448 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:29.862941 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:29.863677 18374 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.863911 18448 consensus_queue.cc:260] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:29.868112 18372 raft_consensus.cc:1275] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:29.874439 18448 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:29.882576 19306 consensus_queue.cc:1048] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260204 08:59:29.894804 18448 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:29.898912 18374 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:29.902240 19050 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:29.902978 19306 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:29.903451 19306 raft_consensus.cc:697] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:29.904915 19306 consensus_queue.cc:237] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:29.906790 18197 catalog_manager.cc:5654] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:29.936820 18199 catalog_manager.cc:5654] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:30.004693 18374 raft_consensus.cc:1275] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:30.005807 19242 consensus_queue.cc:1048] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:30.015096 18521 raft_consensus.cc:1275] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:30.016559 19242 consensus_queue.cc:1048] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:30.286171 18374 raft_consensus.cc:1275] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:30.287300 19289 consensus_queue.cc:1048] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:30.297115 18522 raft_consensus.cc:1275] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:30.298954 19242 consensus_queue.cc:1048] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:30.315446 18521 raft_consensus.cc:1275] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:30.316911 19262 consensus_queue.cc:1048] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:30.328107 18374 raft_consensus.cc:1275] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:30.329669 19301 consensus_queue.cc:1048] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:30.401177 18451 raft_consensus.cc:1275] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:30.402305 19262 consensus_queue.cc:1048] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:30.417034 18376 raft_consensus.cc:1275] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:30.418762 19301 consensus_queue.cc:1048] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:30.441543 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:30.483803 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "097dd514c346448db7708716b992ea2c"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:30.484462 18522 raft_consensus.cc:606] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:30.487003 18451 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:39098
I20260204 08:59:30.487540 18451 raft_consensus.cc:606] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:30.489737 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:30.490121 18522 raft_consensus.cc:606] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:30.491950 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:30.492390 18522 raft_consensus.cc:606] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:30.494406 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:30.494745 18522 raft_consensus.cc:606] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:30.496399 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:30.496745 18522 raft_consensus.cc:606] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:30.497465 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260204 08:59:30.498505 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:30.499125 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:30.527079 19320 raft_consensus.cc:993] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:30.527558 19304 raft_consensus.cc:1081] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:30.528929 19108 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46718
I20260204 08:59:30.529328 19108 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:30.529568 19108 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.535491 19108 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:30.537782 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:30.538249 19108 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:30.538322 18376 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.539099 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:30.539597 18451 raft_consensus.cc:3055] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:30.539848 18451 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:30.540346 18451 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:30.541160 18451 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.544977 18376 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:30.545876 19050 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:30.546764 19301 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:30.546993 18451 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:30.547245 19301 raft_consensus.cc:697] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:30.548175 19301 consensus_queue.cc:237] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:30.557161 18198 catalog_manager.cc:5654] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:30.674631 19249 raft_consensus.cc:993] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:30.675094 19299 raft_consensus.cc:1081] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:30.676465 19109 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46704
I20260204 08:59:30.676962 19109 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:30.677274 19109 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.684036 19109 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:30.685673 19109 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:30.686599 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:30.687194 18448 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.687242 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:30.687902 18522 raft_consensus.cc:3055] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:30.688184 18522 raft_consensus.cc:740] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:30.688828 18522 consensus_queue.cc:260] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:30.689934 18522 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.691797 18448 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:30.692656 19050 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:30.693413 19301 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:30.693828 19301 raft_consensus.cc:697] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:30.694654 19301 consensus_queue.cc:237] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:30.695909 18522 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:30.705335 18198 catalog_manager.cc:5654] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:30.729061 19249 raft_consensus.cc:993] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:30.729451 19299 raft_consensus.cc:1081] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:30.730724 18376 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45710
I20260204 08:59:30.731237 18376 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:30.731527 18376 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.739183 18376 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:30.741967 18376 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:30.743079 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:30.743593 18521 raft_consensus.cc:3055] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:30.743898 18521 raft_consensus.cc:740] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:30.744483 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:30.744629 18521 consensus_queue.cc:260] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:30.745257 18448 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.747231 18521 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.752108 19249 raft_consensus.cc:993] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:30.752550 19249 raft_consensus.cc:1081] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:30.752974 18448 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:30.754235 18340 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:30.753965 18374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45710
I20260204 08:59:30.754978 19271 raft_consensus.cc:2804] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:30.755493 19271 raft_consensus.cc:697] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:30.756615 18374 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:30.756415 19271 consensus_queue.cc:237] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:30.756939 18374 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.766805 19299 raft_consensus.cc:993] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:30.766566 18374 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:30.767270 19299 raft_consensus.cc:1081] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:30.768095 18521 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:30.769217 18374 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:30.769083 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:30.769721 18448 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.770296 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:30.770815 18522 raft_consensus.cc:3055] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:30.771104 18522 raft_consensus.cc:740] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:30.771088 18198 catalog_manager.cc:5654] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:30.772014 18522 consensus_queue.cc:260] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:30.773171 18522 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.775369 19109 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46704
I20260204 08:59:30.775957 19109 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:30.776187 18448 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:30.779177 18340 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:30.776268 19109 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.779783 19271 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:30.780344 19271 raft_consensus.cc:697] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:30.781147 19271 consensus_queue.cc:237] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:30.779727 18522 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:30.785951 19109 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:30.787263 19109 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:30.788285 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:30.788334 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:30.788693 18374 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.789091 18522 raft_consensus.cc:3055] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:30.789333 18522 raft_consensus.cc:740] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:30.789966 18522 consensus_queue.cc:260] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:30.790838 18522 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:30.792286 18198 catalog_manager.cc:5654] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:30.794726 18374 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:30.795030 18522 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:30.795747 19050 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:30.796504 19301 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:30.796959 19301 raft_consensus.cc:697] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:30.797758 19301 consensus_queue.cc:237] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:30.803781 19299 raft_consensus.cc:993] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:30.804244 19249 raft_consensus.cc:1081] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:30.805541 19109 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "097dd514c346448db7708716b992ea2c"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46704
I20260204 08:59:30.805979 19109 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:30.806306 19109 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.808339 18198 catalog_manager.cc:5654] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:30.812574 19109 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:30.815690 19109 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:30.818022 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:30.818292 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:30.818543 18522 raft_consensus.cc:3055] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:30.818804 18374 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.818894 18522 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:30.819720 18522 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:30.820609 18522 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:30.823021 18374 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:30.823909 19050 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:30.824574 19301 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:30.824683 18522 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:30.824977 19301 raft_consensus.cc:697] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:30.825831 19301 consensus_queue.cc:237] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:30.835304 18198 catalog_manager.cc:5654] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:30.971817 18376 raft_consensus.cc:1275] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:30.972851 19301 consensus_queue.cc:1048] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:30.993939 18448 raft_consensus.cc:1275] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:30.995635 19301 consensus_queue.cc:1048] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:31.148140 18448 raft_consensus.cc:1275] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:31.149053 19331 consensus_queue.cc:1048] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:31.154654 18522 raft_consensus.cc:1275] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:31.156123 19302 consensus_queue.cc:1048] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:31.158967 18522 raft_consensus.cc:1275] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:31.161515 19331 consensus_queue.cc:1048] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:31.181542 18448 raft_consensus.cc:1275] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:31.182807 19302 consensus_queue.cc:1048] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:31.233832 18521 raft_consensus.cc:1275] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:31.234972 19302 consensus_queue.cc:1048] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:31.244179 18374 raft_consensus.cc:1275] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:31.245445 19262 consensus_queue.cc:1048] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:31.394584 18451 raft_consensus.cc:1275] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:31.395592 19331 consensus_queue.cc:1048] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:31.406163 18521 raft_consensus.cc:1275] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:31.407585 19331 consensus_queue.cc:1048] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:31.417392 18522 raft_consensus.cc:1275] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:31.418779 19302 consensus_queue.cc:1048] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:31.436075 18374 raft_consensus.cc:1275] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:31.438499 19301 consensus_queue.cc:1048] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:31.535166 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:31.569355 18451 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:39098
I20260204 08:59:31.569790 18451 raft_consensus.cc:606] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:31.571827 18451 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:39098
I20260204 08:59:31.572259 18451 raft_consensus.cc:606] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:31.574301 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:31.574743 18374 raft_consensus.cc:606] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Received request to transfer leadership to TS 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:31.577143 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a76dccca152648179027ee96bc473ad7"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:31.577888 18374 raft_consensus.cc:606] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Received request to transfer leadership to TS 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:31.578783 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260204 08:59:31.580524 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:31.581204 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:31.724983 19245 raft_consensus.cc:993] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower 5bc1d8b58ce0457da263c5c017c92ca4 to start an election
I20260204 08:59:31.725394 19331 raft_consensus.cc:1081] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Signalling peer 5bc1d8b58ce0457da263c5c017c92ca4 to start an election
I20260204 08:59:31.726759 18522 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a76dccca152648179027ee96bc473ad7"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
from {username='slave'} at 127.0.0.1:60760
I20260204 08:59:31.727262 18522 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:31.727609 18522 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:31.733362 18522 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:31.734911 18522 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:31.735810 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:31.735884 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:31.736320 18374 raft_consensus.cc:3055] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:31.736507 18451 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:31.736610 18374 raft_consensus.cc:740] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:31.737406 18374 consensus_queue.cc:260] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:31.738112 18374 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:31.742139 18374 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:31.742681 18451 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:31.742971 18488 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:31.743744 19341 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:31.744203 19341 raft_consensus.cc:697] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:31.744879 19341 consensus_queue.cc:237] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:31.754029 18199 catalog_manager.cc:5654] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:31.760699 19304 raft_consensus.cc:993] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:31.761210 19304 raft_consensus.cc:1081] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:31.762643 18374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45722
I20260204 08:59:31.763049 18374 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:31.763303 18374 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:31.768107 18374 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:31.769680 18374 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:31.770345 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:31.770895 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:31.771459 18522 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:31.770921 18451 raft_consensus.cc:3055] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:31.772542 18451 raft_consensus.cc:740] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:31.773204 18451 consensus_queue.cc:260] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:31.773967 18451 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:31.777482 18522 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:31.778463 18340 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:31.779134 19331 raft_consensus.cc:2804] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:31.779556 19331 raft_consensus.cc:697] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:31.780215 18451 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:31.780351 19331 consensus_queue.cc:237] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:31.789492 18199 catalog_manager.cc:5654] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 2 to 3, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 3 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:31.898836 19320 raft_consensus.cc:993] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:31.899241 19304 raft_consensus.cc:1081] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:31.900388 19108 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46718
I20260204 08:59:31.900768 19108 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:31.900995 19108 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:31.905138 19108 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:31.906453 19108 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:31.907188 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:31.907418 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:31.907821 18376 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:31.907929 18451 raft_consensus.cc:3055] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:31.908308 18451 raft_consensus.cc:740] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:31.908993 18451 consensus_queue.cc:260] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:31.910106 18451 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:31.914083 18376 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:31.915198 19050 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:31.915849 19262 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:31.915853 18451 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:31.916250 19262 raft_consensus.cc:697] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:31.917037 19262 consensus_queue.cc:237] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:31.924675 18199 catalog_manager.cc:5654] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:32.105293 19271 raft_consensus.cc:993] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower 5bc1d8b58ce0457da263c5c017c92ca4 to start an election
I20260204 08:59:32.105700 19331 raft_consensus.cc:1081] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Signalling peer 5bc1d8b58ce0457da263c5c017c92ca4 to start an election
I20260204 08:59:32.106864 18522 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
from {username='slave'} at 127.0.0.1:60760
I20260204 08:59:32.107261 18522 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:32.107502 18522 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:32.111567 18522 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:32.112999 18522 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:32.113560 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:32.113886 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:32.114195 18376 raft_consensus.cc:3055] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:32.114478 18447 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:32.114492 18376 raft_consensus.cc:740] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:32.115336 18376 consensus_queue.cc:260] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:32.116611 18376 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:32.121208 18447 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:32.122413 18488 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:32.122696 18376 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:32.123170 19360 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:32.123611 19360 raft_consensus.cc:697] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:32.124758 19360 consensus_queue.cc:237] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:32.133014 18199 catalog_manager.cc:5654] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:32.260010 18447 raft_consensus.cc:1275] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:32.261014 19360 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:32.264806 18374 raft_consensus.cc:1275] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:32.266616 19341 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:32.347582 18451 raft_consensus.cc:1275] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:32.348707 19301 consensus_queue.cc:1048] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:32.363183 18374 raft_consensus.cc:1275] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:32.364383 19302 consensus_queue.cc:1048] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:32.396042 18521 raft_consensus.cc:1275] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:32.397131 19271 consensus_queue.cc:1048] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:32.406283 18451 raft_consensus.cc:1275] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:32.407590 19271 consensus_queue.cc:1048] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:32.575310 18451 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:32.576506 19341 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:32.586207 18376 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:32.595422 19341 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260204 08:59:32.616228 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:32.652184 18521 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "263a60191abd44948307685e71fc6321"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:32.652596 18521 raft_consensus.cc:606] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:32.654424 18521 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:32.654788 18521 raft_consensus.cc:606] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:32.656543 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:32.656937 18374 raft_consensus.cc:606] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:32.657846 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260204 08:59:32.658852 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:32.659343 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:32.666313 19360 raft_consensus.cc:993] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:32.666812 19341 raft_consensus.cc:1081] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:32.668028 19109 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "263a60191abd44948307685e71fc6321"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46704
I20260204 08:59:32.668408 19109 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:32.668642 19109 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:32.672983 19109 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:32.674326 19109 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:32.675135 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:32.675330 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:32.675734 18451 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:32.675834 18521 raft_consensus.cc:3055] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:32.676247 18521 raft_consensus.cc:740] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:32.676906 18521 consensus_queue.cc:260] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:32.678515 18521 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:32.679620 19331 raft_consensus.cc:993] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:32.680147 19271 raft_consensus.cc:1081] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:32.681607 19109 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46720
I20260204 08:59:32.682127 19109 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:32.682479 19109 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:32.682626 18451 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:32.683727 19050 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:32.684537 19301 raft_consensus.cc:2804] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:32.684970 19301 raft_consensus.cc:697] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:32.685449 18521 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:32.685801 19301 consensus_queue.cc:237] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:32.689105 19109 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:32.690738 19109 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:32.692977 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:32.693264 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:32.693599 18374 raft_consensus.cc:3055] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:32.693953 18447 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:32.694442 18374 raft_consensus.cc:740] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:32.695170 18374 consensus_queue.cc:260] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:32.696789 18374 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:32.704914 18447 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:32.705479 18374 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:32.705935 19050 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:32.706681 19301 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:32.707297 19301 raft_consensus.cc:697] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:32.708130 19301 consensus_queue.cc:237] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:32.711800 18199 catalog_manager.cc:5654] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:32.726459 18199 catalog_manager.cc:5654] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:33.076874 18524 raft_consensus.cc:1275] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:33.078001 19302 consensus_queue.cc:1048] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:33.099400 18447 raft_consensus.cc:1275] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:33.100948 19380 consensus_queue.cc:1048] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260204 08:59:33.175194 18447 raft_consensus.cc:1275] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:33.175212 19386 raft_consensus.cc:993] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:33.175899 19341 raft_consensus.cc:1081] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:33.176422 19380 consensus_queue.cc:1048] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:33.181005 18376 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45710
I20260204 08:59:33.181510 18376 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:33.181835 18376 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:33.187263 18374 raft_consensus.cc:1275] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:33.187892 18376 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:33.188645 19301 consensus_queue.cc:1048] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:33.190366 18376 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:33.191561 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:33.192055 18524 raft_consensus.cc:3055] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:33.192319 18524 raft_consensus.cc:740] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:33.192374 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:33.192996 18451 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:33.193014 18524 consensus_queue.cc:260] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:33.194675 18524 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:33.213709 18524 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:33.216187 18451 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:33.217310 18340 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:33.218009 19271 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:33.218353 19271 raft_consensus.cc:697] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:33.218953 19271 consensus_queue.cc:237] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:33.226569 18198 catalog_manager.cc:5654] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 3 to 4, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:33.818292 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:34.415863 19396 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:34.416450 19396 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:34.400527 19399 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:34.409919 19393 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:34.423895 19393 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:34.424983 19396 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:34.425846 19393 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:34.430928 19402 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:34.428418 19399 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:34.432235 18377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:34.432924 18377 raft_consensus.cc:606] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:34.434759 19399 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:34.436411 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260204 08:59:34.437175 19396 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:34.437691 19396 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:34.438124 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:34.439666 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:34.432777 19402 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:34.441730 19402 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:34.448695 19399 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:34.449237 19399 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:34.452759 19399 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:34.453258 19399 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:34.454623 19398 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:34.455163 19398 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:34.457181 19398 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:34.611017 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:34.611970 18521 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:34.453696 19399 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:34.806994 19393 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:34.807631 19393 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:34.827912 19393 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:34.807950 19395 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:34.808195 19394 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:34.828894 19395 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:34.829366 19394 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:34.831070 19395 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:34.831305 19394 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:34.828879 19399 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:34.825623 19396 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:34.966706 19393 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:34.901562 19398 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.097065 19399 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.097656 19399 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.099638 19399 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.100174 19399 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.100616 19399 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.102509 19399 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.103010 19399 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:34.967000 19395 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.088461 19394 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.107733 19411 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.116299 19396 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.116667 19406 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.116796 19396 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.117278 19406 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.118835 19396 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.119338 19396 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 08:59:35.105568 19051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s user 0.023s sys 0.036s
I20260204 08:59:35.115607 19412 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 08:59:35.093760 19050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s user 0.039s sys 0.047s
I20260204 08:59:35.122489 19396 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.103463 19399 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:35.133132 18489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s user 0.000s sys 0.003s
W20260204 08:59:35.133415 19051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s user 0.023s sys 0.036s
I20260204 08:59:35.096329 19393 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.133582 19402 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.106135 19398 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:35.108229 18398 debug-util.cc:398] Leaking SignalData structure 0x7b080029fdc0 after lost signal to thread 15378
I20260204 08:59:35.134138 19405 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.108580 19395 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.139236 19405 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.140353 19398 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.140442 19395 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.141009 19398 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.141074 19395 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.109278 19394 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.141726 19395 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.143386 19394 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.134341 19401 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 08:59:35.135406 19050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s user 0.040s sys 0.048s
I20260204 08:59:35.130417 19411 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.144038 19401 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.145344 19411 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:35.137326 18489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s user 0.000s sys 0.004s
I20260204 08:59:35.141168 19405 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.143581 19395 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:35.136097 18414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s user 0.004s sys 0.000s
I20260204 08:59:35.146131 19401 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:35.146389 18414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s user 0.004s sys 0.000s
I20260204 08:59:35.119385 19406 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.147145 19398 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.149073 19398 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.149236 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.133630 19410 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.149946 19410 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.151922 19410 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.152371 19410 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.155383 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.155893 18374 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:35.152801 19410 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.156810 19402 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.158686 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.160924 19399 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.161623 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.149256 19320 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.152702 19393 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.157559 19401 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.163883 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.163965 19401 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.163432 19411 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.165462 19411 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.165690 19320 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.166842 19419 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.167126 19409 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.169329 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.161556 19402 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.167860 19320 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.181638 19405 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.183437 19320 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.183622 19405 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.162288 18370 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:35.184002 19320 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.167347 19419 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.185609 19405 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.185868 19320 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.161984 19396 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.187986 19408 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.165627 19400 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.188480 19408 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.185945 19419 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.188926 19400 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.136193 19412 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.166715 19407 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.186396 19320 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.187834 19404 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.193833 19302 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.193758 19396 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.193964 19320 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.194590 19302 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.194733 19396 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.195948 19320 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.196455 19302 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.196630 19396 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.197175 19396 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.194227 19404 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.202055 19404 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.202666 18376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 707) took 1933 ms. Trace:
I20260204 08:59:35.203068 19407 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.203099 18376 rpcz_store.cc:276] 0204 08:59:33.269444 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:35.195265 (+1925821us) service_pool.cc:225] Handling call
0204 08:59:35.195537 (+ 272us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:35.202349 (+ 6812us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:35.202378 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:35.202430 (+ 52us) raft_consensus.cc:1645] Marking committed up to 1
0204 08:59:35.202463 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:35.202516 (+ 53us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:35.202617 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:35.167918 19409 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.167362 19411 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.201972 19302 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.206892 19405 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.217283 19414 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.217790 19414 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.218158 19409 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.219131 19400 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.206007 19406 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.206882 19411 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.205965 19402 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.219871 19302 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.233187 19302 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.197615 19396 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.234899 19396 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.221953 19410 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.237784 19410 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.238267 19410 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.240077 19410 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.219978 19406 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.226385 19405 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.226133 19417 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.221908 19407 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.216673 19419 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.220302 19414 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.228416 19402 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.231540 19404 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.240494 19411 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.221493 19401 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.242555 19412 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.259413 19419 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.266103 19401 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.266389 19320 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.263631 19404 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.268580 19414 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.255609 19417 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.322667 19402 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.324414 19419 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.318693 19320 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.326560 19406 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.327142 19320 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.327039 19414 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:35.328276 18398 debug-util.cc:398] Leaking SignalData structure 0x7b080028ce80 after lost signal to thread 18234
I20260204 08:59:35.328547 19425 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.329032 19425 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.330148 19417 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.315892 19405 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.330922 19425 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:35.331790 19052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s user 0.006s sys 0.008s
I20260204 08:59:35.331939 19411 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.333743 19427 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.334268 19427 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.336759 18524 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260204 08:59:35.342037 19052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s user 0.006s sys 0.011s
I20260204 08:59:35.343534 19409 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.343782 19396 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.317480 19401 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.344103 19380 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.344159 19409 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.344657 19422 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.344803 19380 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.345134 19422 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.344355 19302 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.349057 19302 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.349794 19427 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.350040 19380 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.349925 19409 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.350847 19302 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.351136 19414 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.351614 19396 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.342068 19411 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.352226 19404 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.353554 19401 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.343691 19421 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 08:59:35.350219 18398 debug-util.cc:398] Leaking SignalData structure 0x7b080011d100 after lost signal to thread 18401
I20260204 08:59:35.357975 19415 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.359835 19423 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.365152 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.366237 19422 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.374996 19106 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:35.375388 19396 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.376289 19417 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.376829 19417 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:35.378839 18398 debug-util.cc:398] Leaking SignalData structure 0x7b080030bd60 after lost signal to thread 18475
I20260204 08:59:35.379478 19417 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:35.380004 18398 debug-util.cc:398] Leaking SignalData structure 0x7b08002deee0 after lost signal to thread 18549
W20260204 08:59:35.381161 18398 debug-util.cc:398] Leaking SignalData structure 0x7b08000ae6e0 after lost signal to thread 19135
I20260204 08:59:35.382503 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.382820 19423 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.385138 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.385811 19099 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:35.388147 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.388800 18522 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:35.377267 19408 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:35.368901 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 45424.1us
I20260204 08:59:35.366871 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.385974 19422 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.393543 19422 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.394469 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.392125 19100 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:35.397246 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.397679 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.398304 19101 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:35.377970 19421 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.401149 19421 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.395490 19422 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.373232 19411 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.405588 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.408190 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.403317 19423 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.408008 19396 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.412185 19417 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.424154 19396 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.419317 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.426162 19396 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.406415 19425 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:35.404345 19320 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.416270 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.414381 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.427070 19422 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.427281 19430 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.429431 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.429747 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.419070 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.419421 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.429979 19430 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.431036 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.419760 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.432016 19430 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.411089 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.448426 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.449020 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.450083 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.450912 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.451121 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.423417 18343 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:35.452847 18343 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:35.423722 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.424206 19417 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.456332 19050 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.457491 19417 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.417738 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.458774 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.459803 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.460315 19109 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:35.460573 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.461030 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.461442 19404 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.461673 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.461956 19404 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.462690 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.462927 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.426820 19425 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.426995 19320 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.418387 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.461040 19417 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.463980 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.464196 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.432263 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.464669 19425 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.426975 19411 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.432914 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.466926 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.467223 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.468209 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.468262 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.468341 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.469252 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.469710 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.470235 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.471210 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.472162 18450 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:35.472474 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.434290 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.473852 19101 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:35.473907 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.435118 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.427596 19422 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.462045 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.476388 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.477998 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.478192 18447 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:35.432201 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.436308 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.479188 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.437312 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.480110 19105 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:35.440789 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.441689 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.442348 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.442371 18491 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.482637 19408 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.482865 18491 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.483489 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.484597 18491 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.484793 19419 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:35.485164 19419 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.485487 19419 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.443146 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.444406 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.486572 19414 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.486976 19414 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.487304 19414 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.484638 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.490814 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.491770 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.493446 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.493773 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.493399 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.495126 19408 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:35.477902 19320 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.495370 19412 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.436759 19421 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.495934 19412 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.494858 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.476450 19422 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.496968 19408 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.497934 19404 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.498538 19393 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.495292 18491 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.499008 19393 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.499334 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.499949 18491 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.500145 19406 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.500500 19406 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.500830 19406 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.501354 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.500910 19393 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.501981 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.497869 19412 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.501839 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.503818 19405 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.504235 19405 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.503847 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.504899 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.505323 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.504570 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.506503 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.507149 18444 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:35.508873 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.499984 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.509846 19399 raft_consensus.cc:993] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:35.509163 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.503247 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.445492 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.463831 19417 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.421136 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.496274 19421 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.504565 19405 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.494412 18373 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:35.384495 19415 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.512961 19417 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.513150 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.513769 18445 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:35.514115 19415 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.514268 19399 raft_consensus.cc:1081] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:35.514642 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.514909 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.447758 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.477795 19434 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.516062 18451 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:35.516134 18376 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:35.516530 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.516979 19421 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.517110 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.517202 19107 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:35.477834 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.511507 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.520129 18450 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:35.501905 18447 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:35.510190 19371 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260204 08:59:35.523896 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.529616 18343 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:35.535741 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.536747 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.536933 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.537964 19428 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.538369 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.538703 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.538869 19399 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 08:59:35.539690 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 58478.4us
I20260204 08:59:35.518438 19434 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.529999 18340 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.544090 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.544648 18376 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:35.494320 19414 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.548071 18447 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47922
I20260204 08:59:35.532505 19393 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:35.532222 19421 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.539356 19399 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.551017 18447 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:35.554880 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.539530 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.555842 18488 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.556782 18447 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.557950 18414 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:35.551324 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.558736 19420 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.560566 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.561654 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.559177 19420 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.560607 18340 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.562968 19420 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.563297 19398 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.564409 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.566793 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.549199 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.568535 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.569859 19050 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:35.569149 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.570096 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.570160 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:35.571915 19271 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.543000 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.572261 19271 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.572271 18340 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.572767 19271 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.543138 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.550736 19393 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.574501 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.548731 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.551479 19371 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.576081 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.576324 19395 raft_consensus.cc:2749] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.576611 19414 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.577179 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.538481 19428 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.577740 18373 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:35.577625 19422 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:35.588721 19422 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.589115 19422 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.589551 19428 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.577611 19050 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.578059 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.578986 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.579897 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.580725 19413 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.564540 19402 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.595904 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.558917 19433 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.596493 19433 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.559376 19412 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260204 08:59:35.596899 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.563699 19398 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.597913 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.577253 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.584339 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.584542 18488 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.582592 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.552709 19419 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.562610 19432 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.559233 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.558753 19425 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:35.551388 19102 raft_consensus.cc:2468] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:35.604008 18488 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.589161 19399 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.612602 18340 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:35.613065 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.613313 19412 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.613706 19412 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.614066 19412 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.614289 19419 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.613489 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.586109 19271 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.592301 19050 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.569491 19421 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.616315 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.616950 19419 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:35.617751 19050 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.618044 19416 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.618146 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.618507 19416 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.592779 19411 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.619150 19416 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.593367 18442 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:35.590507 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.560310 19405 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.620205 19050 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.624181 19396 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.624574 19405 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.596603 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.582681 19393 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.552330 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.590142 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.592569 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.600826 19402 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:35.596918 19433 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.597942 19398 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.600564 19406 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.598531 18414 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.547851 19408 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.604738 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.604216 19435 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.603262 19432 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.605458 19415 raft_consensus.cc:2749] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.640619 18523 raft_consensus.cc:1240] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.606455 18488 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.606627 18343 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.643016 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.604532 19425 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.643620 19107 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.607378 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.645222 19432 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.645546 19399 raft_consensus.cc:2804] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.645905 19399 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.646020 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.646293 19399 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.643683 19417 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.596006 19413 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.608314 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.643844 19425 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.609314 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.638674 19435 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.648169 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.610620 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.615411 19104 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.618489 19301 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.648561 19413 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.588009 19431 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.620494 19411 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.620749 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.622321 19271 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.636322 18447 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.629210 19050 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:35.629858 18340 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:35.632035 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.657985 19271 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:35.607740 19434 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.662695 19050 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.657209 19431 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.643061 19393 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.609619 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.649896 18488 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.648911 19301 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.665776 18488 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.666236 18447 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.656067 19106 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.629537 19419 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.686053 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.686726 18518 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:35.658579 19271 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.687160 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.644033 19422 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.659117 18340 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:35.666348 19398 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.696136 19105 raft_consensus.cc:1240] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:35.696482 18340 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.697371 19398 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.665488 19301 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.666815 19415 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.697633 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.651211 18449 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:35.667202 19431 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.646802 19406 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.669209 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.699313 19395 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.699707 19395 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.699855 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.700170 19395 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.700292 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.700744 19415 consensus_queue.cc:1059] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:35.670111 19393 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.671702 19411 raft_consensus.cc:2749] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.671875 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.690815 19413 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.672708 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.674074 19104 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:35.674381 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.672001 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.651243 19341 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.676220 19405 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:35.717303 19405 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.717697 19405 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:35.656219 19403 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.676985 19408 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:35.677485 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.719839 19403 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.720245 19403 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.677505 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.678150 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.678785 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.678881 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.721235 19108 raft_consensus.cc:1240] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.679394 19107 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:35.651465 19421 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.681198 19050 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.680706 18414 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:35.733246 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 52624.1us
I20260204 08:59:35.735086 18414 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.681960 18488 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.684049 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.684413 19425 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.687536 19271 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.616768 19420 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:35.737007 18450 raft_consensus.cc:1240] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
W20260204 08:59:35.737246 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 56126.9us
I20260204 08:59:35.737910 19425 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.692222 19419 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.692539 19399 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.693256 19412 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.694397 19106 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:35.694675 18417 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.695291 19435 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.698894 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.702430 19402 raft_consensus.cc:3055] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:35.700325 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.703866 18340 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:35.708165 19301 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.709882 19395 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.680375 19433 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.712486 19422 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.687055 19416 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.715005 19398 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:35.722631 19109 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.724588 18491 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.735602 19403 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.726956 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.728297 19405 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.725478 19413 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.690713 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.738296 19420 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.737939 19050 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.738077 19396 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.739102 19431 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.739501 19425 raft_consensus.cc:2749] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.740338 19399 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.750777 19398 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.741516 19436 consensus_queue.cc:1059] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:35.747756 19393 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.742444 19421 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:35.742611 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 48012.1us
I20260204 08:59:35.742758 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.744895 19271 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.761423 19271 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.741165 19408 raft_consensus.cc:2749] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.749619 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.750182 18491 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.761765 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:35.762462 18491 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.762686 19301 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:35.736117 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 54230.7us
I20260204 08:59:35.763558 19415 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:35.764046 19415 raft_consensus.cc:697] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:35.764118 18488 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:35.765192 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:35.764961 19415 consensus_queue.cc:237] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.765347 18488 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.765923 19412 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.762365 19436 raft_consensus.cc:3055] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:35.751758 19419 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:35.766736 19436 raft_consensus.cc:740] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:35.766953 19419 raft_consensus.cc:697] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:35.750191 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:35.743170 19402 raft_consensus.cc:740] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:35.750850 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.753640 19433 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.815037 19395 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:35.816720 19403 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.817487 18488 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.740883 18414 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:35.820714 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 79895.9us
I20260204 08:59:35.821035 19401 raft_consensus.cc:2749] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.757388 18417 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.809206 19436 consensus_queue.cc:260] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.824767 19436 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.827836 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.828940 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.830034 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:35.830601 18373 raft_consensus.cc:3055] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:35.830906 18373 raft_consensus.cc:740] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:35.830992 18340 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.831624 18373 consensus_queue.cc:260] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.832561 18373 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
W20260204 08:59:35.809677 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 52808.1us
I20260204 08:59:35.835222 19050 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.835958 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:35.754158 19398 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.837054 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.838207 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.752009 19423 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.810024 19107 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.809808 19402 consensus_queue.cc:260] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.849951 19402 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.764273 19341 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:35.810817 18368 raft_consensus.cc:1240] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.810987 19405 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.811378 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:35.812127 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:35.756445 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:35.760516 19393 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:35.840310 19050 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.840508 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:35.841205 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.841538 19411 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.861016 18444 raft_consensus.cc:1240] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:35.861380 19411 raft_consensus.cc:2749] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.861323 19050 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.862746 19050 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.863408 19301 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.863996 19301 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.857643 18518 raft_consensus.cc:1240] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:35.865083 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:35.866674 19341 raft_consensus.cc:697] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:35.867749 19341 consensus_queue.cc:237] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.808919 19429 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.765213 19414 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:35.844844 19419 consensus_queue.cc:237] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:35.881757 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 63167.8us
I20260204 08:59:35.883231 18488 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.884011 19401 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:35.840142 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:35.847901 18340 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.887687 18340 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.888034 19412 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:35.856455 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:35.888702 18340 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.886816 19414 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:35.889786 18340 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.852574 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:35.890336 19371 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.890542 18447 raft_consensus.cc:2393] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 3: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:35.839437 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:35.891393 18517 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:35.892784 18488 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:35.854208 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 96864.4us
I20260204 08:59:35.893448 19420 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.894541 19420 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.896468 19420 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.893941 18417 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.898195 18417 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.899187 18417 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.893996 19418 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.893345 18340 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.900800 18517 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:35.860167 19435 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.865126 19393 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.901793 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.902115 19418 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.888749 19412 raft_consensus.cc:2749] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.905450 18340 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.907310 19412 raft_consensus.cc:2749] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.908056 19428 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:35.909139 19428 raft_consensus.cc:2749] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.909675 19428 raft_consensus.cc:2749] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.847872 19398 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.910972 18417 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.912019 19432 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.912624 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:35.913568 18417 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.914386 19107 raft_consensus.cc:2468] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:35.916049 18343 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:35.917373 19418 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.917834 19418 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.919816 19412 raft_consensus.cc:2804] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:35.920168 19428 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.920352 19412 raft_consensus.cc:697] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:35.921437 19412 consensus_queue.cc:237] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:35.924588 18414 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.876564 19050 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.845244 19394 raft_consensus.cc:2749] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.889874 19414 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:35.925796 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.924093 19393 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.927560 19405 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.928318 18518 raft_consensus.cc:1240] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:35.929657 19435 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260204 08:59:35.930703 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 54215.4us
I20260204 08:59:35.931380 19050 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.756021 19416 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.932418 19050 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.933074 18414 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.933477 19423 raft_consensus.cc:2749] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.935267 19411 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.936365 18518 raft_consensus.cc:1240] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:35.764082 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:35.933183 19403 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.943020 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:35.944662 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:35.945709 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:35.924623 19418 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.934916 19050 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.935108 19405 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.937045 18417 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.937793 18414 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.934459 18340 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.939790 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:35.951529 18417 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.955861 18488 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.958714 19050 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.960497 18374 raft_consensus.cc:1240] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.961858 18521 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.964378 18376 raft_consensus.cc:1240] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.965098 19415 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:35.965361 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:35.965617 19415 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:35.938925 19436 raft_consensus.cc:2749] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.944238 19404 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:35.967485 18414 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.970131 18417 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:35.955513 19398 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:35.995537 18340 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.992865 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.017781 19393 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:36.042906 19431 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.992401 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:36.043969 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 76568.7us
I20260204 08:59:36.017206 19415 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:35.992786 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:35.953145 19341 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:36.045378 19341 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:36.045672 19431 raft_consensus.cc:2749] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260204 08:59:36.045585 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 50125.5us
I20260204 08:59:35.966642 19417 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.046571 18340 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.995474 19426 consensus_queue.cc:1059] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260204 08:59:36.047416 19341 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:36.065241 18521 raft_consensus.cc:1240] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.026574 19414 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.048576 19394 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.968817 19401 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 08:59:36.045254 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 75202.7us
I20260204 08:59:36.013095 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:36.011888 18377 raft_consensus.cc:1240] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.053232 18414 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:36.093333 18414 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.994891 19271 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:36.094223 19417 raft_consensus.cc:2749] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:36.093991 19431 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.094589 19271 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:36.047803 18340 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.095979 19431 consensus_queue.cc:1059] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260204 08:59:36.096113 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 48392.1us
I20260204 08:59:36.096977 19417 raft_consensus.cc:3055] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:36.097540 19271 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:36.097711 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:36.097856 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.098129 19271 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.999008 19395 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:36.097307 19417 raft_consensus.cc:740] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.099053 19395 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:36.099993 19417 consensus_queue.cc:260] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:35.969327 19420 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.101447 19395 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:36.102106 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:36.022197 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:35.969169 19432 raft_consensus.cc:2749] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.105262 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:36.105667 18340 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.107741 19394 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.009989 18373 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:36.108917 18340 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.109604 19395 raft_consensus.cc:2749] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.110719 18340 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:35.969220 19402 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.111363 19395 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:36.111711 18519 raft_consensus.cc:1240] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.955855 19405 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.112382 18340 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.113075 19395 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.063777 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:36.028457 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:36.019078 19404 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:36.115702 19404 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:36.016779 18370 raft_consensus.cc:1240] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.117688 19393 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:35.955925 19421 raft_consensus.cc:2749] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:35.993098 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:36.047755 19426 raft_consensus.cc:3055] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.119714 19426 raft_consensus.cc:740] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:35.965112 19403 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.120491 19426 consensus_queue.cc:260] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.121057 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:36.121603 19426 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.121189 18198 catalog_manager.cc:5654] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:35.972350 18372 raft_consensus.cc:1240] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:35.991274 19050 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:35.957551 19416 raft_consensus.cc:2749] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.125008 19403 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:36.126004 19403 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:36.090929 19401 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.126385 19403 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
W20260204 08:59:36.124959 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 133765us
I20260204 08:59:36.091836 18417 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:36.131870 19401 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:36.137427 19431 raft_consensus.cc:2749] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.132768 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:36.114117 19405 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:36.130224 19050 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.141220 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.142182 19404 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.143182 19416 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.143319 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
W20260204 08:59:36.132910 18340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:36.133875 18414 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:36.145771 19421 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:36.146221 19421 raft_consensus.cc:697] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.147007 19421 consensus_queue.cc:237] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.090126 19414 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:36.132357 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 160767us
I20260204 08:59:36.150584 18517 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:36.151611 19403 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.152153 19428 consensus_queue.cc:1059] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:36.151615 19414 consensus_queue.cc:1059] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:36.172204 19107 raft_consensus.cc:1275] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:36.153630 18370 raft_consensus.cc:1240] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
W20260204 08:59:36.137511 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 45756.2us
I20260204 08:59:36.155196 19402 consensus_queue.cc:1059] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.156176 18375 raft_consensus.cc:1240] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:36.156657 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.157567 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:36.173863 19271 raft_consensus.cc:2749] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.169229 19431 consensus_queue.cc:1059] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260204 08:59:36.177456 19432 consensus_queue.cc:1059] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.178354 19402 raft_consensus.cc:3055] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.178741 18488 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:36.179848 19429 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:36.178747 19402 raft_consensus.cc:740] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.180502 19341 consensus_queue.cc:1059] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:36.181690 19401 raft_consensus.cc:3055] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.181483 19402 consensus_queue.cc:260] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:36.182042 19401 raft_consensus.cc:740] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.182822 19402 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.182797 19401 consensus_queue.cc:260] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.183780 19401 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.193152 18340 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.190564 19414 consensus_queue.cc:1048] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.197113 18370 raft_consensus.cc:1240] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:36.197975 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.199443 19393 raft_consensus.cc:2749] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.199546 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:36.201702 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:36.171967 19404 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:36.202773 19404 raft_consensus.cc:3055] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.203111 19404 raft_consensus.cc:740] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.204454 19426 raft_consensus.cc:3055] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.204838 19426 raft_consensus.cc:740] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.205626 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:36.207749 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.211805 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.214284 18340 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.159418 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:36.224114 18524 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:36.160245 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:36.160916 19435 consensus_queue.cc:1059] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.162851 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:36.163151 18199 catalog_manager.cc:5654] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:36.225617 19435 consensus_queue.cc:1243] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer 5bc1d8b58ce0457da263c5c017c92ca4 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260204 08:59:36.164397 18518 raft_consensus.cc:1240] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.165077 18372 raft_consensus.cc:1240] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.165838 18373 raft_consensus.cc:1240] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.165715 19436 consensus_queue.cc:1059] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.167708 18374 raft_consensus.cc:1240] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:36.153225 19425 consensus_queue.cc:1059] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.227922 18199 catalog_manager.cc:5654] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:36.228870 19425 consensus_queue.cc:1243] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer 5bc1d8b58ce0457da263c5c017c92ca4 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260204 08:59:36.229339 19425 raft_consensus.cc:3055] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.229643 19425 raft_consensus.cc:740] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.229431 18199 catalog_manager.cc:5654] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 2 to 3, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:36.230342 19425 consensus_queue.cc:260] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.230752 19341 consensus_queue.cc:1059] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.227689 19436 consensus_queue.cc:1059] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:36.215610 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:36.219532 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:36.231766 19341 consensus_queue.cc:1059] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:36.220966 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:36.232542 19431 consensus_queue.cc:1059] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.222012 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.233080 19405 raft_consensus.cc:3055] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:36.233450 19405 raft_consensus.cc:740] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.234678 19405 consensus_queue.cc:260] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.232609 19341 raft_consensus.cc:3055] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.237123 19341 raft_consensus.cc:740] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.238024 19341 consensus_queue.cc:260] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.239202 19341 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.239986 19426 consensus_queue.cc:260] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.203838 19404 consensus_queue.cc:260] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.241285 19426 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.241560 19404 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.158828 19417 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:36.164250 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:36.243453 18377 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.244779 19405 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:36.249861 18377 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:36.250816 18488 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:36.252708 19402 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:36.253345 19402 raft_consensus.cc:697] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.222736 19403 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:36.256091 19452 raft_consensus.cc:3055] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.257946 19452 raft_consensus.cc:740] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 08:59:36.256536 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 83611.9us
I20260204 08:59:36.258759 18417 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:36.260411 19425 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.261397 19452 consensus_queue.cc:260] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:36.268040 19452 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.266601 19050 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.271414 19416 raft_consensus.cc:2749] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.283629 19403 consensus_queue.cc:1059] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:36.285085 19411 raft_consensus.cc:3055] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:36.285410 19411 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:36.286445 19425 raft_consensus.cc:3055] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.286098 19411 consensus_queue.cc:260] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:36.287302 19425 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.291574 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:36.291565 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.294767 19411 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:36.298465 19050 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:36.288434 19425 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.303534 19431 raft_consensus.cc:3055] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:36.304033 19431 raft_consensus.cc:740] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.305145 19431 consensus_queue.cc:260] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:36.306588 19271 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260204 08:59:36.306746 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 92539.5us
I20260204 08:59:36.307806 19428 consensus_queue.cc:1243] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer 5bc1d8b58ce0457da263c5c017c92ca4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260204 08:59:36.308007 18340 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:36.308388 19432 consensus_queue.cc:1243] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer 44601d9bf1ce4a70a5b01dcfc505d276 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260204 08:59:36.308753 19420 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.312650 18340 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:36.313380 19393 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:36.313720 19393 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:36.314052 19393 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:36.314844 19435 raft_consensus.cc:3055] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.315265 19435 raft_consensus.cc:740] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.316076 19435 consensus_queue.cc:260] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:36.317265 19435 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.320283 18340 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:36.321125 19420 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:36.308633 19271 consensus_queue.cc:1059] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260204 08:59:36.322916 19271 raft_consensus.cc:3055] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.323218 19271 raft_consensus.cc:740] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:36.323297 19107 raft_consensus.cc:1275] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:36.327497 19426 consensus_queue.cc:1048] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:36.324057 19271 consensus_queue.cc:260] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:36.330513 18340 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:36.344950 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 143690us
I20260204 08:59:36.345110 19271 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.336062 19421 raft_consensus.cc:2749] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:36.347848 18414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:36.348776 18414 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:36.349606 19393 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:36.351931 19393 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:36.329107 19450 log.cc:927] Time spent T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.076s user 0.001s sys 0.000s
W20260204 08:59:36.347528 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 87736.3us
I20260204 08:59:36.361241 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:36.342151 19416 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:36.343115 19420 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.365945 18488 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.367209 18488 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:36.371259 18417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:36.372576 19109 raft_consensus.cc:1240] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.374341 18488 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.375711 18488 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.376535 19108 raft_consensus.cc:1240] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.384537 19100 raft_consensus.cc:1240] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.389950 18447 raft_consensus.cc:1275] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:36.375452 19414 raft_consensus.cc:2749] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.374665 19452 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:36.374786 19405 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.406656 19454 raft_consensus.cc:3055] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:36.435711 19454 raft_consensus.cc:740] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.407212 19431 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:36.405460 19458 consensus_queue.cc:1059] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260204 08:59:36.380414 19401 raft_consensus.cc:2749] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.381050 19429 raft_consensus.cc:2749] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.358021 19402 consensus_queue.cc:237] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.413334 18522 raft_consensus.cc:1240] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
W20260204 08:59:36.443131 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 97993.1us
I20260204 08:59:36.424814 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:36.362016 19451 consensus_queue.cc:1059] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260204 08:59:36.434729 19106 raft_consensus.cc:1275] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:36.450474 19050 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.450632 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.451054 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:36.451694 19050 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.453172 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:36.453390 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.454720 19411 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.445288 18443 raft_consensus.cc:1240] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:36.458550 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.462188 19050 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.459436 18447 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:36.469810 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:36.471977 19105 raft_consensus.cc:1275] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:36.473047 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.474931 19403 raft_consensus.cc:2749] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.476456 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.476687 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.472008 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:36.447556 19416 raft_consensus.cc:697] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:36.491297 19416 consensus_queue.cc:237] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.484853 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:36.443394 19418 consensus_queue.cc:1048] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260204 08:59:36.488552 19414 consensus_queue.cc:1048] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.488447 18343 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:36.484628 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:36.496074 18450 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
W20260204 08:59:36.505714 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 44984us
I20260204 08:59:36.494598 18197 catalog_manager.cc:5654] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:36.508011 18377 raft_consensus.cc:1240] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.502512 18488 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.462946 19411 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.488330 19104 raft_consensus.cc:1240] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
W20260204 08:59:36.510844 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:36.512833 19398 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:36.516570 18448 raft_consensus.cc:1275] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:36.517259 19438 consensus_queue.cc:1048] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260204 08:59:36.515331 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:36.438380 19454 consensus_queue.cc:260] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.519052 18488 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.527697 19417 raft_consensus.cc:3055] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.528121 19417 raft_consensus.cc:740] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.528365 19452 consensus_queue.cc:1059] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.529919 18417 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:36.527513 19432 consensus_queue.cc:1059] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.470930 19465 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.536504 18488 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.531798 19436 consensus_queue.cc:1059] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260204 08:59:36.540400 19454 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:36.527556 19106 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.540418 18377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:36.542024 18377 raft_consensus.cc:606] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.542348 18377 raft_consensus.cc:614] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 08:59:36.537442 19452 raft_consensus.cc:2749] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.551630 19425 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.552287 19417 consensus_queue.cc:260] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.553558 19417 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.537688 19429 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:36.559454 18444 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:36.560307 19341 raft_consensus.cc:2749] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.561299 19419 consensus_queue.cc:1059] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.562276 19419 raft_consensus.cc:3055] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.562592 19419 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.562733 19393 consensus_queue.cc:1059] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 08:59:36.564200 18488 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.565503 19429 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.566491 18488 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:36.563454 19420 raft_consensus.cc:3055] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:36.581202 18488 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.587237 19426 raft_consensus.cc:2749] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:36.587908 19426 consensus_queue.cc:1048] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.538858 19405 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:36.597177 18488 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:36.569923 19429 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:36.569347 19432 raft_consensus.cc:3055] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.572064 19104 raft_consensus.cc:1240] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.600461 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a934695b181f40f0a55ece7603079f63"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:36.607988 18522 raft_consensus.cc:606] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.610991 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:36.611527 18522 raft_consensus.cc:606] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.611974 18522 raft_consensus.cc:614] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 08:59:36.605613 19429 raft_consensus.cc:697] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.613034 19429 consensus_queue.cc:237] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.606071 19109 raft_consensus.cc:1240] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:36.615010 18377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:36.615726 18377 raft_consensus.cc:606] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:36.617714 19458 consensus_queue.cc:1059] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.620535 18522 raft_consensus.cc:1275] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:36.622022 19458 consensus_queue.cc:1048] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:36.567407 19419 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.572543 19420 raft_consensus.cc:740] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:36.624493 19419 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.624866 19420 consensus_queue.cc:260] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:36.626616 19420 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:36.627800 18198 catalog_manager.cc:5654] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
W20260204 08:59:36.631258 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 168108us
I20260204 08:59:36.632426 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260204 08:59:36.600495 19432 raft_consensus.cc:740] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.640564 19050 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:36.640686 19432 consensus_queue.cc:260] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:36.641518 19461 raft_consensus.cc:2749] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:36.641553 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:36.641990 19432 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:36.643021 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:36.654382 18446 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:36.625308 19402 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:36.632663 19428 raft_consensus.cc:3055] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.661046 19428 raft_consensus.cc:740] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.667773 19402 raft_consensus.cc:697] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:36.837771 19432 consensus_queue.cc:1059] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.838991 19431 raft_consensus.cc:3055] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:36.839347 19431 raft_consensus.cc:740] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:36.840150 19431 consensus_queue.cc:260] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:36.841499 19431 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
W20260204 08:59:36.846881 18415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:36.850759 18451 raft_consensus.cc:1275] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260204 08:59:36.855579 19464 log.cc:927] Time spent T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.187s user 0.000s sys 0.009s
I20260204 08:59:36.855875 19402 consensus_queue.cc:237] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:36.551894 19455 consensus_queue.cc:1175] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260204 08:59:36.871063 18442 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:36.877593 18377 raft_consensus.cc:1275] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:36.879209 19341 consensus_queue.cc:1048] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:36.891152 19428 consensus_queue.cc:260] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:36.892702 19428 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
W20260204 08:59:36.895948 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 215771us
I20260204 08:59:36.905092 18450 raft_consensus.cc:1275] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:36.909785 18450 raft_consensus.cc:1275] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:36.915041 19414 consensus_queue.cc:1048] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:36.926158 19481 consensus_queue.cc:1048] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:36.937120 18199 catalog_manager.cc:5654] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:36.916754 19419 consensus_queue.cc:1048] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:36.948585 18368 raft_consensus.cc:1275] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:36.955436 18373 raft_consensus.cc:1240] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:36.968124 19432 consensus_queue.cc:1048] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260204 08:59:37.029991 18374 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:36.988680 19423 consensus_queue.cc:1059] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260204 08:59:37.041553 18374 raft_consensus.cc:1275] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:37.042448 19418 raft_consensus.cc:993] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:37.043114 19418 raft_consensus.cc:1081] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:37.045506 19419 consensus_queue.cc:1048] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:37.045296 19423 raft_consensus.cc:3055] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:37.047290 19423 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:37.048085 19423 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.048764 19107 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46720
I20260204 08:59:37.049309 19107 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:37.049616 19107 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:37.060006 19107 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.059571 18197 catalog_manager.cc:5654] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:37.049328 19423 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.062714 18197 catalog_manager.cc:5654] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 3 to 4, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 4 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:37.067672 19107 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.079826 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:37.080487 18444 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:37.088624 19402 raft_consensus.cc:993] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:37.085980 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:37.091709 19402 raft_consensus.cc:1081] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:37.093286 18443 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a934695b181f40f0a55ece7603079f63"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47928
I20260204 08:59:37.093815 18443 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:37.094184 18443 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:37.100175 18450 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.105844 18443 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:37.112190 18442 raft_consensus.cc:1275] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:37.112354 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:37.091945 18370 raft_consensus.cc:3055] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:37.115473 18522 raft_consensus.cc:1275] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:37.115692 18370 raft_consensus.cc:740] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:37.107699 18450 raft_consensus.cc:1275] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:37.116967 19403 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:37.115435 18518 raft_consensus.cc:3055] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:37.118201 19484 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:37.120047 18518 raft_consensus.cc:740] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:37.116918 18370 consensus_queue.cc:260] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.120826 18518 consensus_queue.cc:260] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:37.121974 18518 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:37.122011 18370 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:37.118162 19426 consensus_queue.cc:1048] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260204 08:59:37.129897 18443 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:37.135639 18518 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:37.137200 18414 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.137506 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:37.120225 18444 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:37.138090 19107 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:37.139796 19428 raft_consensus.cc:2804] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:37.140324 19428 raft_consensus.cc:697] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:37.141129 19428 consensus_queue.cc:237] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:37.143250 18370 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:37.144640 19050 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:37.145563 19107 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:37.145852 19403 raft_consensus.cc:2804] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:37.146361 19403 raft_consensus.cc:697] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:37.147166 19403 consensus_queue.cc:237] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.173101 18198 catalog_manager.cc:5654] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 2, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 2 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:37.189597 19403 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:37.190160 19403 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:37.192016 19403 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:37.196249 18198 catalog_manager.cc:5654] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:37.199067 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:37.199486 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:37.199858 18450 raft_consensus.cc:2393] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 2: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:37.201192 19050 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:37.202131 19403 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:37.211169 19403 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:37.302130 19100 raft_consensus.cc:1275] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:37.303387 19426 consensus_queue.cc:1048] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:37.312089 18450 raft_consensus.cc:1275] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:37.313823 19402 consensus_queue.cc:1048] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:37.417693 19403 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.418200 19403 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.420104 19403 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.420702 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.421416 18370 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:37.421566 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:37.422284 18450 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:37.422720 19050 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:37.423448 19403 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:37.423816 19403 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.424134 19403 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.428794 19402 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.429296 19402 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.430962 19402 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.431164 19403 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.431622 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.433085 19403 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.434700 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:37.432509 18370 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:37.438443 18488 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:37.439112 19402 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.435352 18450 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:37.438464 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:37.440107 18370 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.439450 19402 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.440567 19402 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.442838 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:37.443430 18451 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.447810 19402 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.451000 19402 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.451169 18370 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:37.452809 19050 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:37.452929 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:37.453485 18444 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.453657 19403 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:37.454192 19403 raft_consensus.cc:697] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:37.455004 19403 consensus_queue.cc:237] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.463712 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:37.464411 18370 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.470065 18451 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:37.471321 18370 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:37.472738 18199 catalog_manager.cc:5654] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:37.480788 18488 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:37.482360 19415 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:37.482471 18444 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:37.482896 19415 raft_consensus.cc:697] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:37.483757 19415 consensus_queue.cc:237] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.507050 18199 catalog_manager.cc:5654] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:37.538961 18444 raft_consensus.cc:1275] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:37.540180 19403 consensus_queue.cc:1048] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:37.551705 19428 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.552179 19428 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.553704 18374 raft_consensus.cc:1275] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:37.553948 19428 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.554517 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:37.555081 19107 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:37.555171 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.555855 18370 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:37.556171 18417 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.557106 19428 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:37.557461 19428 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.557762 19428 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.560884 19484 consensus_queue.cc:1048] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:37.573993 18522 raft_consensus.cc:1275] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:37.575464 19455 consensus_queue.cc:1048] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:37.577558 19415 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.578015 19415 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.582194 19415 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.583436 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:37.584987 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.587774 18370 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:37.570657 19428 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.588737 18488 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:37.590246 19405 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.590592 19405 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.590899 19405 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.591998 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:37.592751 19271 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.593206 19271 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.595454 19107 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.595870 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:37.597548 19271 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:37.598984 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:37.599682 18518 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:37.601063 19405 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.601851 18340 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:37.602900 19271 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.603314 19271 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.603606 19271 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.603699 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:37.607772 19405 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.609735 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:37.602855 19107 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:37.610934 18370 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.609601 19271 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.614624 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:37.615170 18518 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.617199 18417 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.621630 18518 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:37.623253 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:37.623301 18340 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:37.624086 18374 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.624258 19418 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:37.624610 19271 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:37.624965 19418 raft_consensus.cc:697] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:37.625795 19418 consensus_queue.cc:237] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.621196 18370 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:37.629505 19428 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.629678 18488 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:37.631281 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:37.631726 19405 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:37.632454 19405 raft_consensus.cc:697] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:37.633247 19405 consensus_queue.cc:237] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.636008 19428 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:37.636483 19428 raft_consensus.cc:697] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:37.637320 19428 consensus_queue.cc:237] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.639004 18374 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:37.642624 19107 raft_consensus.cc:1275] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:37.647461 19503 consensus_queue.cc:1048] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:37.666901 18199 catalog_manager.cc:5654] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:37.676848 19402 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.677477 19402 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.678035 18198 catalog_manager.cc:5654] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:37.682811 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.683445 18374 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:37.685429 18488 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:37.686296 19419 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:37.686669 19419 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.687011 19419 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.692238 19301 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:37.692745 19301 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.733778 19419 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.734324 19402 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.742925 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:37.743568 18374 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.752137 19419 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.739953 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:37.755465 18444 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:37.757535 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:37.739560 19301 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.763934 18444 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:37.766433 18374 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:37.767238 19405 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.767894 19405 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.770714 19405 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.772698 18444 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:37.774375 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.774938 18374 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:37.774978 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:37.776491 18488 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.777655 19415 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:37.777951 18488 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:37.778105 19415 raft_consensus.cc:697] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:37.778792 19429 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.779168 19429 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.779575 19429 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.778956 19415 consensus_queue.cc:237] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:37.788380 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 51862.5us
I20260204 08:59:37.789911 19429 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.790572 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.791397 18374 raft_consensus.cc:2368] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3.
I20260204 08:59:37.791975 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:37.793301 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:37.793848 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:37.794284 19394 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.794404 18374 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.794764 19394 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.796622 19394 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:37.797410 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:37.798535 19429 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.798998 19394 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.799566 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:37.799563 19394 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.800336 18518 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:37.801270 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:37.795637 18199 catalog_manager.cc:5654] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:37.802487 19394 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:37.802913 19418 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.803303 19418 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.803608 19418 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.809434 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:37.814484 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:37.815019 18522 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:37.816856 19418 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.817342 18374 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:37.818431 19418 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:37.819525 18340 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:37.819821 18488 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:37.820542 19509 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:37.820642 19271 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.821025 19271 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.821323 19271 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.821026 19509 raft_consensus.cc:697] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:37.822276 19509 consensus_queue.cc:237] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.823760 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:37.824648 18198 catalog_manager.cc:5654] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:37.826139 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:37.828106 18518 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.828430 19423 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:37.828917 19423 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:37.830754 19423 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.832247 19271 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.834339 18518 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:37.835366 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:37.837198 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:37.839299 19271 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:37.840111 19271 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:37.840607 19271 raft_consensus.cc:697] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:37.841390 19271 consensus_queue.cc:237] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.818940 19050 leader_election.cc:400] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3.
I20260204 08:59:37.843331 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:37.846827 19050 leader_election.cc:403] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:37.847025 18518 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.847412 19423 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.853794 18518 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:37.854106 19428 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.854703 19428 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.853822 19423 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3.
I20260204 08:59:37.855829 18340 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:37.856702 19428 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.857136 19418 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:37.857610 19418 raft_consensus.cc:697] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:37.858058 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:37.858639 19107 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:37.858434 19418 consensus_queue.cc:237] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.859783 18417 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.859949 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.861595 18199 catalog_manager.cc:5654] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:37.863827 19428 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.864324 19428 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.864674 19428 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.870846 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:37.871589 18518 raft_consensus.cc:2368] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3.
I20260204 08:59:37.873155 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.881719 19428 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.884781 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:37.885275 19107 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.888685 19050 leader_election.cc:400] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3.
I20260204 08:59:37.889113 19050 leader_election.cc:403] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:37.889626 19423 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.889784 18199 catalog_manager.cc:5654] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 3 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:37.891290 18199 catalog_manager.cc:5654] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 3 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:37.893925 19107 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:37.894951 18417 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.895692 19505 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:37.896168 19505 raft_consensus.cc:697] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:37.896623 19423 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3.
I20260204 08:59:37.896974 19505 consensus_queue.cc:237] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.908111 18199 catalog_manager.cc:5654] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:37.910960 19428 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.912212 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:37.918637 19418 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:37.919154 19418 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.921249 19418 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.922073 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:37.922688 18451 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:37.922739 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:37.922242 18374 raft_consensus.cc:1275] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:37.923583 19107 raft_consensus.cc:2393] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 2: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:37.923799 18340 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.924527 19418 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:37.924883 19418 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:37.924952 19429 consensus_queue.cc:1048] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:37.925251 19418 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:37.933995 19418 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.935781 19418 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:37.937054 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:37.937635 18451 raft_consensus.cc:1275] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:37.937747 19107 raft_consensus.cc:2393] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 2: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:37.939025 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:37.943840 19415 consensus_queue.cc:1048] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:37.948688 18444 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:37.949697 18340 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:37.950656 19271 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:37.951059 19271 raft_consensus.cc:697] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:37.951742 19271 consensus_queue.cc:237] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.952757 18451 raft_consensus.cc:1275] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:37.954170 19513 consensus_queue.cc:1048] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:37.955149 19428 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.955621 19428 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:37.957459 19428 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:37.959009 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.959599 18374 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:37.959805 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:37.960469 19107 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:37.961709 18417 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.964612 19455 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.964968 19455 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:37.965267 19455 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:37.969050 19428 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.969527 19428 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.972788 19428 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:37.973428 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.974069 18370 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:37.977267 18414 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:37.976603 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:37.977766 19428 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:37.978770 19505 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:37.985075 19513 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:37.993642 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:37.985141 19503 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:37.979959 18518 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:37.990437 19428 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:37.998658 19503 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.000115 19428 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.000420 19503 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.003186 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:38.004002 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:38.007117 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:38.008342 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:38.008812 18522 raft_consensus.cc:2368] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:37.997489 19513 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.011036 18370 raft_consensus.cc:2368] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.011612 19513 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.013314 18368 raft_consensus.cc:1275] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:38.014600 19504 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:38.020375 19504 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.021395 18414 leader_election.cc:400] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.021694 18414 leader_election.cc:403] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:38.022253 19504 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.022742 19504 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.022828 18414 leader_election.cc:400] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.023160 18414 leader_election.cc:403] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:38.025246 19503 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.016276 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:38.026165 18450 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:38.025187 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:38.030463 18518 raft_consensus.cc:2368] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.030665 18197 catalog_manager.cc:5654] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:38.017805 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:38.032546 19050 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:38.033986 19513 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:38.034330 19513 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:38.034633 19513 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.036067 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:37.990947 19505 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:38.038206 19505 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.020476 19455 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:38.042768 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:38.043264 19107 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.045131 18414 leader_election.cc:400] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.045467 18414 leader_election.cc:403] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:38.056145 19423 consensus_queue.cc:1048] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:38.062624 19428 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.068599 19107 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:38.072400 18417 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:38.092628 19505 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.101496 19513 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.093152 19504 raft_consensus.cc:2749] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.104372 19418 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 08:59:38.104812 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 59796.8us
I20260204 08:59:38.105161 19418 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:38.107628 19505 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.108278 19418 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:38.109037 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:38.109196 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:38.109805 19100 raft_consensus.cc:2368] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3.
I20260204 08:59:38.110054 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:38.110595 18444 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.110867 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:38.108265 19505 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:38.111428 18370 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.111528 19505 raft_consensus.cc:697] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:38.111785 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:38.112376 18374 raft_consensus.cc:606] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:38.112521 19505 consensus_queue.cc:237] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:38.111537 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:38.103446 19513 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.113682 18373 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.119365 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:38.119289 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:38.122660 19503 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.126547 18343 leader_election.cc:400] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3.
I20260204 08:59:38.131515 18343 leader_election.cc:403] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:38.106181 19455 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:38.132596 19271 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 3
W20260204 08:59:38.128929 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 56607.1us
I20260204 08:59:38.132014 18518 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.138914 19509 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:38.139374 19509 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.141114 19509 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:38.143505 19398 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:38.144029 19398 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:38.147248 18520 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:38.147879 18520 raft_consensus.cc:606] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:38.149803 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:38.150507 18451 raft_consensus.cc:2393] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:38.147096 19428 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.153167 19271 raft_consensus.cc:2749] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3.
I20260204 08:59:38.145717 19398 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:38.158247 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:38.158814 18374 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:38.159950 18488 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:38.161144 19415 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:38.161520 19415 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:38.161996 19415 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:38.161633 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:38.162973 19107 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:38.163887 18343 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:38.164510 19271 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:38.164994 19271 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:38.165264 19271 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:38.166471 18374 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:38.167053 18374 raft_consensus.cc:606] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:38.151602 18444 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:38.165589 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:38.172216 18522 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:38.172109 19271 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:38.172785 18522 raft_consensus.cc:606] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:38.173522 18370 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:38.174355 19050 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:38.175700 19423 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:38.174744 19107 raft_consensus.cc:1275] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.176497 19423 raft_consensus.cc:697] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:38.178144 19423 consensus_queue.cc:237] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.178068 19429 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:38.179035 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260204 08:59:38.183264 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:38.184222 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:38.185663 19523 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:38.186134 19523 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:38.183373 18518 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:38.188433 18414 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:38.187997 19523 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:38.188890 19415 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.189543 19504 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:38.190025 19504 raft_consensus.cc:697] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:38.190829 19415 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:38.191049 19504 consensus_queue.cc:237] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.192757 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:38.192958 19107 raft_consensus.cc:1275] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.193578 18444 raft_consensus.cc:2393] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:38.194375 19394 consensus_queue.cc:1048] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:38.196362 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:38.192066 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:38.199729 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:38.200201 18451 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:38.201386 18374 raft_consensus.cc:1275] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:38.202728 19527 consensus_queue.cc:1048] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:38.207937 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:38.209765 19484 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:38.210124 19484 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:38.210445 19484 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.216806 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:38.221136 18377 raft_consensus.cc:1275] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.222550 18370 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:38.222492 19509 consensus_queue.cc:1048] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:38.227210 18488 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:38.227936 19271 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:38.230254 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:38.230880 19109 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:38.233537 18370 raft_consensus.cc:1275] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.235985 19510 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.236923 19415 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:38.237439 19415 raft_consensus.cc:697] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:38.238462 19415 consensus_queue.cc:237] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.239455 18444 raft_consensus.cc:1275] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:38.244107 19109 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:38.245465 18343 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:38.218451 18373 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:38.261382 19528 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:38.338279 18522 raft_consensus.cc:1275] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.348407 19394 consensus_queue.cc:1048] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.257725 19509 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260204 08:59:38.357908 19528 raft_consensus.cc:697] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 08:59:38.360342 19525 log.cc:927] Time spent T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260204 08:59:38.394443 18451 raft_consensus.cc:1275] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.403142 19271 consensus_queue.cc:1048] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.411108 19429 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:38.411860 19429 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.414050 19429 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:38.421008 19109 raft_consensus.cc:1275] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:38.423611 19524 consensus_queue.cc:1048] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:38.426723 19484 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:38.427532 18370 raft_consensus.cc:1275] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.428489 19528 consensus_queue.cc:237] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:38.429239 19524 consensus_queue.cc:1048] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260204 08:59:38.414182 19534 log.cc:927] Time spent T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.092s user 0.000s sys 0.003s
I20260204 08:59:38.449373 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:38.450147 18450 raft_consensus.cc:2368] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3.
I20260204 08:59:38.456351 18199 catalog_manager.cc:5654] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:38.457895 18199 catalog_manager.cc:5654] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:38.492174 19109 raft_consensus.cc:1275] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.494609 18450 raft_consensus.cc:1275] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.508479 18521 raft_consensus.cc:1275] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.498246 19543 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:38.494264 19524 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:38.519968 18488 leader_election.cc:400] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161) with higher term. Message: Invalid argument: T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3.
I20260204 08:59:38.521629 18488 leader_election.cc:403] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:38.523732 19105 raft_consensus.cc:1240] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:38.518522 19415 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:38.522104 18197 catalog_manager.cc:5654] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 1 to 3, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:38.507092 19504 consensus_queue.cc:1048] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260204 08:59:38.519767 18444 raft_consensus.cc:1275] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:38.538203 19484 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:38.539577 19536 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.540380 19546 consensus_queue.cc:1048] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.528095 19524 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.544961 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:38.523072 19538 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:38.545737 19538 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:38.547578 19538 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:38.527256 19415 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.524113 19543 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.563112 19539 raft_consensus.cc:993] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:38.563659 19539 raft_consensus.cc:1081] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:38.564163 19543 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.567505 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:38.571377 18451 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:38.578748 18446 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47922
I20260204 08:59:38.589354 19271 consensus_queue.cc:1048] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.588301 18446 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:38.591049 18446 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:38.591434 19398 consensus_queue.cc:1059] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.593335 19398 raft_consensus.cc:3055] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:38.595726 18447 raft_consensus.cc:1275] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.593688 19398 raft_consensus.cc:740] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:38.616524 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:38.622004 19398 consensus_queue.cc:260] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:38.623327 19398 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.613595 18443 raft_consensus.cc:1275] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.634258 19524 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:38.634608 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 225867us
I20260204 08:59:38.641062 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:38.641789 19107 raft_consensus.cc:2368] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5.
I20260204 08:59:38.624505 19536 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161) with higher term. Message: Invalid argument: T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3.
I20260204 08:59:38.653687 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:38.645660 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:38.654284 18521 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:38.632149 19553 consensus_queue.cc:1048] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260204 08:59:38.664975 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:38.665670 18518 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:38.671753 19560 raft_consensus.cc:993] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:38.665153 19526 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:38.672757 19526 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.674866 19526 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.672089 19104 raft_consensus.cc:1275] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.647141 19551 consensus_queue.cc:1048] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260204 08:59:38.677704 18414 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:38.678443 19505 consensus_queue.cc:1048] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.680568 18491 leader_election.cc:400] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5.
I20260204 08:59:38.672222 19560 raft_consensus.cc:1081] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:38.680903 18491 leader_election.cc:403] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:38.685899 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:38.688992 19405 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 5
I20260204 08:59:38.682755 18372 raft_consensus.cc:2410] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260204 08:59:38.700477 19107 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46720
I20260204 08:59:38.701742 19050 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:38.701009 19107 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:38.703012 19107 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.680913 19455 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:38.646791 18446 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:38.725955 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 202936us
I20260204 08:59:38.713493 19301 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:38.716888 19415 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:38.735432 19107 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:38.722028 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:38.722244 19455 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:38.742478 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:38.747299 18442 raft_consensus.cc:1240] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:38.730856 19301 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:38.752139 19301 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.755671 19107 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:38.751891 19455 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:38.753564 18368 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:38.762638 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:38.766868 18372 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260204 08:59:38.768620 18446 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.744848 19528 consensus_queue.cc:1048] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260204 08:59:38.769431 18374 raft_consensus.cc:1275] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:38.771929 19455 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.773742 19455 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:38.776216 18518 raft_consensus.cc:1275] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.772765 19301 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.776427 18414 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:38.779740 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:38.780169 18372 raft_consensus.cc:1275] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.780288 18374 raft_consensus.cc:3055] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:38.780604 18374 raft_consensus.cc:740] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:38.782371 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:38.782260 18374 consensus_queue.cc:260] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.783114 18374 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:38.794282 18522 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:38.800516 19428 consensus_queue.cc:1048] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.802068 19524 consensus_queue.cc:1048] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.809612 18414 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:38.773780 19518 log.cc:927] Time spent T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.105s user 0.002s sys 0.000s
I20260204 08:59:38.775517 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:38.814762 19301 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.767530 19405 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5.
I20260204 08:59:38.824803 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:38.815982 19524 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:38.826365 19524 raft_consensus.cc:697] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:38.827193 19524 consensus_queue.cc:237] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:38.833449 19541 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 08:59:38.835619 19101 raft_consensus.cc:2393] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 3: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
W20260204 08:59:38.831408 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 86950.9us
I20260204 08:59:38.805279 19455 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:38.844362 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:38.844904 18373 raft_consensus.cc:3055] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:38.845216 18373 raft_consensus.cc:740] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:38.847179 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:38.847609 18522 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.854619 18522 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:38.822165 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:38.846395 19455 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:38.857769 19455 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:38.860873 18374 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:38.862032 18414 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:38.864640 19455 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:38.867552 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:38.869975 18373 consensus_queue.cc:260] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:38.867277 18518 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:38.833525 19537 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260204 08:59:38.871965 18521 raft_consensus.cc:1240] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:38.871908 18522 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.874161 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:38.876467 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:38.871476 18517 raft_consensus.cc:1275] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.884025 18523 raft_consensus.cc:1275] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:38.885340 19549 raft_consensus.cc:993] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:38.885783 19549 raft_consensus.cc:1081] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:38.889041 19546 raft_consensus.cc:993] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:38.889493 19546 raft_consensus.cc:1081] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Signalling peer 44601d9bf1ce4a70a5b01dcfc505d276 to start an election
I20260204 08:59:38.889707 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:38.890355 18370 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
W20260204 08:59:38.891029 19565 log.cc:927] Time spent T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.065s user 0.002s sys 0.000s
I20260204 08:59:38.899099 19050 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:38.901121 18522 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:38.878039 19484 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:38.877439 19569 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:38.882448 18373 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.914294 18374 raft_consensus.cc:1275] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.908967 18197 catalog_manager.cc:5654] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 4 to 5, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 5 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:38.921597 18375 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:45710
I20260204 08:59:38.922181 18375 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:38.922536 18375 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:38.940186 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:38.945092 18446 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47928
I20260204 08:59:38.945297 18520 raft_consensus.cc:1275] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:38.945744 18446 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:38.948226 18446 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:38.949028 19554 consensus_queue.cc:1048] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260204 08:59:38.934325 19504 consensus_queue.cc:1048] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260204 08:59:38.952307 19099 raft_consensus.cc:1275] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260204 08:59:38.953994 19567 log.cc:927] Time spent T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.129s user 0.002s sys 0.000s
I20260204 08:59:38.927866 19545 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:38.960631 19271 consensus_queue.cc:1048] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:38.927802 19569 raft_consensus.cc:697] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:38.942054 19455 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:38.943076 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:38.973773 19050 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:38.972860 19553 consensus_queue.cc:1048] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260204 08:59:39.048398 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 63945us
W20260204 08:59:39.054929 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 71491.6us
I20260204 08:59:39.055109 18450 raft_consensus.cc:1240] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:39.047479 19106 raft_consensus.cc:2368] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:38.981527 19545 raft_consensus.cc:697] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:39.059321 19423 consensus_queue.cc:1048] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:39.060155 19545 consensus_queue.cc:237] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:39.061450 18373 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:39.062564 18375 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:39.064740 18375 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:39.065475 19484 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:39.068207 18446 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:39.070221 18446 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:39.079747 19484 raft_consensus.cc:697] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:39.080687 19484 consensus_queue.cc:237] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:39.088280 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:39.095865 18199 catalog_manager.cc:5654] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 3 to 5, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 5 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:39.100160 18417 leader_election.cc:400] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3.
I20260204 08:59:39.103708 18488 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:39.124235 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:39.124889 19105 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:39.128031 19572 log.cc:927] Time spent T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.106s user 0.000s sys 0.000s
I20260204 08:59:39.129510 18445 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:39.130203 19573 consensus_queue.cc:1059] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260204 08:59:39.131052 19573 raft_consensus.cc:3055] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 08:59:39.131392 19573 raft_consensus.cc:740] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:39.088851 18520 raft_consensus.cc:3055] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:39.119714 19538 raft_consensus.cc:2749] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:39.099025 18370 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 08:59:39.136524 18520 raft_consensus.cc:740] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:39.197909 18414 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:39.200243 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:39.235556 18516 raft_consensus.cc:3055] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:39.213449 18368 raft_consensus.cc:1240] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260204 08:59:39.132191 19573 consensus_queue.cc:260] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:39.214391 19504 raft_consensus.cc:2804] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:39.238315 18516 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
W20260204 08:59:39.267876 19579 log.cc:927] Time spent T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260204 08:59:39.277236 18516 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:39.270505 18518 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:39.289469 18521 raft_consensus.cc:1240] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260204 08:59:39.214179 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:39.238574 18520 consensus_queue.cc:260] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:39.266785 19567 log.cc:927] Time spent T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
W20260204 08:59:39.279945 19578 log.cc:927] Time spent T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.132s user 0.000s sys 0.000s
W20260204 08:59:39.283627 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 147920us
I20260204 08:59:39.139269 19569 consensus_queue.cc:237] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:39.285918 18340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:39.298502 19100 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:39.298743 19504 raft_consensus.cc:697] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [term 6 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:39.299221 19105 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:39.307333 19573 raft_consensus.cc:3060] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:39.293771 19549 consensus_queue.cc:1059] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260204 08:59:39.316819 18520 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:39.339329 19576 log.cc:927] Time spent T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.237s user 0.001s sys 0.000s
W20260204 08:59:39.329982 19580 log.cc:927] Time spent T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.063s user 0.001s sys 0.000s
I20260204 08:59:39.350365 18343 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:39.359840 18520 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:39.368705 19528 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:39.375841 19528 raft_consensus.cc:697] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:39.376724 19528 consensus_queue.cc:237] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:39.390431 19100 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
W20260204 08:59:39.412750 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 100814us
I20260204 08:59:39.413406 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:39.434944 18417 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:39.407966 19504 consensus_queue.cc:237] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:39.440438 19455 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:39.443486 19455 raft_consensus.cc:697] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:39.444315 19455 consensus_queue.cc:237] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:39.441502 19101 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:39.453562 18520 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:39.456522 19428 consensus_queue.cc:1059] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:39.457325 19428 raft_consensus.cc:3055] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:39.457628 19428 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:39.458384 19428 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:39.459436 19428 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:39.525910 18197 catalog_manager.cc:5654] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 3 to 4, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 4 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:39.532351 18197 catalog_manager.cc:5654] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
W20260204 08:59:39.590492 19545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s user 0.043s sys 0.056s
W20260204 08:59:39.593611 19545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s user 0.043s sys 0.056s
W20260204 08:59:39.604233 19484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s user 0.007s sys 0.017s
W20260204 08:59:39.608757 19484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s user 0.007s sys 0.017s
I20260204 08:59:39.614787 19104 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
W20260204 08:59:39.617360 18489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:39.624845 18369 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:34972
W20260204 08:59:39.665583 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:39.638453 18369 raft_consensus.cc:606] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Received request to transfer leadership to TS 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:39.674890 18445 raft_consensus.cc:1275] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260204 08:59:39.675287 18445 pending_rounds.cc:85] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: Aborting all ops after (but not including) 1
I20260204 08:59:39.676945 18445 pending_rounds.cc:107] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260204 08:59:39.677166 18445 raft_consensus.cc:2889] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:39.681605 18516 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:39.685190 19484 consensus_queue.cc:1048] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260204 08:59:39.711524 18199 catalog_manager.cc:5654] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 3 to 4, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:39.720417 18516 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:39.721526 18518 raft_consensus.cc:1275] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:39.724275 19543 consensus_queue.cc:1048] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:39.787976 18518 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:39.790006 18518 raft_consensus.cc:606] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:39.799849 18518 raft_consensus.cc:614] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 08:59:39.798239 18199 catalog_manager.cc:5654] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:39.803050 18518 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a76dccca152648179027ee96bc473ad7"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:52174
I20260204 08:59:39.803864 18518 raft_consensus.cc:606] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:39.804435 18199 catalog_manager.cc:5654] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:39.807629 18372 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:39.808367 18372 raft_consensus.cc:606] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:39.811720 18372 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:39.812558 18372 raft_consensus.cc:606] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:39.814077 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260204 08:59:39.839746 18516 raft_consensus.cc:1275] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:39.845161 19394 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:39.846004 19394 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:39.854432 19418 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:39.855062 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:39.856333 19100 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:39.857457 19394 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:39.868623 18518 raft_consensus.cc:1275] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:39.869427 18369 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260204 08:59:39.870440 19455 consensus_queue.cc:1048] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:39.869488 18343 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:39.872563 19394 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:39.872958 19394 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:39.873294 19394 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:39.877450 18519 raft_consensus.cc:1275] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260204 08:59:39.877842 19505 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 08:59:39.885016 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:39.877907 18519 pending_rounds.cc:85] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: Aborting all ops after (but not including) 4
I20260204 08:59:39.892778 18519 pending_rounds.cc:107] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260204 08:59:39.908457 18519 raft_consensus.cc:2889] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:39.914407 19602 consensus_queue.cc:1048] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 08:59:39.921327 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:39.922592 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:39.922030 18198 catalog_manager.cc:5654] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 2 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:39.927554 18198 catalog_manager.cc:5654] T 4cf3dc838d4343bab90e123d525dfc82 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 5 to 6, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 6 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:39.941639 19100 raft_consensus.cc:1275] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:39.958812 18369 raft_consensus.cc:1275] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:39.960033 19455 consensus_queue.cc:1048] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:39.961206 19428 consensus_queue.cc:1048] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:39.996157 19398 raft_consensus.cc:993] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:39.996891 19554 raft_consensus.cc:1081] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:40.020933 19104 raft_consensus.cc:1275] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:40.030200 18444 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47922
I20260204 08:59:40.030635 19554 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:40.032871 18518 raft_consensus.cc:1275] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:40.034060 18444 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:40.034448 18444 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:40.040740 19602 consensus_queue.cc:1048] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:40.044595 19595 raft_consensus.cc:993] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:40.045104 19595 raft_consensus.cc:1081] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:40.047154 18445 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a76dccca152648179027ee96bc473ad7"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47928
I20260204 08:59:40.047729 18445 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:40.048084 18445 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:40.074105 19558 raft_consensus.cc:993] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:40.076086 19558 raft_consensus.cc:1081] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Signalling peer 354a648f08a44b98a7f93d74b0ea93ab to start an election
I20260204 08:59:40.078804 19104 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
from {username='slave'} at 127.0.0.1:46720
I20260204 08:59:40.079349 19104 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:40.079711 19104 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:40.102720 18444 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:40.107329 19394 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:40.113472 19568 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:40.114246 19568 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:40.117524 19568 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:40.118486 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:40.119319 19107 raft_consensus.cc:2393] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 3: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:40.123383 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:40.124133 18377 raft_consensus.cc:2368] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4.
I20260204 08:59:40.128508 18414 leader_election.cc:400] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4.
I20260204 08:59:40.128839 18414 leader_election.cc:403] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:40.130769 19104 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:40.137784 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:40.140693 19107 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:40.139952 18444 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:40.145888 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:40.150308 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:40.151014 19101 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:40.145505 18445 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:40.151532 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:40.152952 18372 raft_consensus.cc:3055] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:40.138126 19568 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 4
I20260204 08:59:40.140810 19394 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:40.153481 18372 raft_consensus.cc:740] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:40.158728 18445 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:40.159958 18372 consensus_queue.cc:260] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:40.161151 18372 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:40.165931 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:40.166137 19394 raft_consensus.cc:993] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276: : Instructing follower c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:40.166524 18377 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:40.166730 19271 raft_consensus.cc:1081] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Signalling peer c61e83e5fb7445e8bce7eca695977903 to start an election
I20260204 08:59:40.168733 18444 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b"
dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:47922
I20260204 08:59:40.169318 18444 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260204 08:59:40.169618 18444 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:40.172509 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:40.173277 18519 raft_consensus.cc:3055] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:40.173624 18519 raft_consensus.cc:740] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:40.176297 18377 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:40.177796 18414 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:40.181610 19107 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:40.187943 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:40.188562 18517 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:40.191736 18343 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:40.192389 18372 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:40.192665 19271 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:40.193176 19271 raft_consensus.cc:697] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:40.193992 19271 consensus_queue.cc:237] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:40.194759 18519 consensus_queue.cc:260] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:40.196110 18519 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:40.196753 18414 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:40.197669 19428 raft_consensus.cc:2804] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:40.198133 19428 raft_consensus.cc:697] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:40.185266 19602 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:40.200057 19602 raft_consensus.cc:697] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:40.200239 19428 consensus_queue.cc:237] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:40.204787 19602 consensus_queue.cc:237] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:40.205505 18517 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:40.206825 19050 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:40.207472 19568 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4.
I20260204 08:59:40.208583 19301 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:40.209080 19301 raft_consensus.cc:697] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:40.209892 19301 consensus_queue.cc:237] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:40.220381 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:40.212306 19104 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:40.239239 18449 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:40.257483 19101 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:40.258551 19099 raft_consensus.cc:1240] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 1. Current term is 2. Ops: []
W20260204 08:59:40.675473 19615 log.cc:927] Time spent T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.074s user 0.000s sys 0.001s
I20260204 08:59:40.674283 18519 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:40.732743 18377 raft_consensus.cc:3055] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:40.733145 18377 raft_consensus.cc:740] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:40.733908 18377 consensus_queue.cc:260] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:40.734997 18377 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
W20260204 08:59:40.735523 18341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:40.748716 18377 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:40.749616 18372 raft_consensus.cc:1275] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:40.238533 18444 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:40.766911 18444 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:40.772037 18518 raft_consensus.cc:1275] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:40.773723 19620 consensus_queue.cc:1048] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:40.811991 19624 consensus_queue.cc:1048] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260204 08:59:41.340286 18372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s user 0.059s sys 0.134s
W20260204 08:59:41.343993 18372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s user 0.059s sys 0.135s
W20260204 08:59:41.342685 18414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s user 0.113s sys 0.291s
W20260204 08:59:41.347561 18414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s user 0.113s sys 0.291s
W20260204 08:59:41.378515 18416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s user 0.080s sys 0.153s
W20260204 08:59:41.378906 18416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s user 0.080s sys 0.153s
I20260204 08:59:41.412501 19629 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:41.413275 19629 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:41.415494 19629 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:41.642058 19629 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:41.642701 19629 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:41.644696 19629 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:41.645159 19629 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:41.645635 19629 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:41.649103 19629 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:41.807027 19629 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:41.812793 19629 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:41.815013 19629 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:41.987232 18414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s user 0.004s sys 0.035s
W20260204 08:59:41.988884 18414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s user 0.005s sys 0.035s
W20260204 08:59:41.999995 18415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.105s user 0.028s sys 0.014s
W20260204 08:59:42.000427 18415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.105s user 0.028s sys 0.014s
I20260204 08:59:42.001272 19631 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 08:59:42.001649 18341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s user 0.022s sys 0.056s
W20260204 08:59:42.001909 18341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s user 0.022s sys 0.056s
I20260204 08:59:42.001820 19631 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:42.002750 18341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:42.057461 18372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s user 0.000s sys 0.014s
W20260204 08:59:42.057917 18372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s user 0.000s sys 0.014s
W20260204 08:59:42.001382 18340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s user 0.008s sys 0.002s
W20260204 08:59:42.107273 18340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s user 0.009s sys 0.002s
W20260204 08:59:42.107713 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 765503us
I20260204 08:59:42.114482 19629 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:42.115167 19629 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:42.149686 18368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 169) took 1400 ms. Trace:
I20260204 08:59:42.150251 18368 rpcz_store.cc:276] 0204 08:59:40.748729 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:42.148593 (+1399864us) service_pool.cc:225] Handling call
0204 08:59:42.149005 (+ 412us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:42.149205 (+ 200us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:42.149235 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:42.149282 (+ 47us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:42.149315 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:42.149374 (+ 59us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:42.149526 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 08:59:42.217952 18449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47922 (request call id 532) took 2068 ms (client timeout 2136 ms). Trace:
I20260204 08:59:42.218405 18446 raft_consensus.cc:1275] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260204 08:59:42.218458 18449 rpcz_store.cc:269] 0204 08:59:40.149645 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:40.151184 (+ 1539us) service_pool.cc:225] Handling call
0204 08:59:42.217710 (+2066526us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54003f98d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:42.217853 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":129662208}
I20260204 08:59:42.308840 19590 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:42.339728 19590 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:42.341807 19590 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:42.342276 19590 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:42.342705 19590 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:42.354409 19626 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:42.355014 19626 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:42.356873 19626 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:42.357331 19626 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:42.357750 19626 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:42.362383 18472 debug-util.cc:398] Leaking SignalData structure 0x7b0800137020 after lost signal to thread 15378
I20260204 08:59:42.347409 19629 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:42.370707 19629 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:42.372234 19629 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:42.380141 19631 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:42.380808 19631 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:42.381222 19631 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:42.383093 19631 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:42.385039 19590 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:42.383505 19631 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:42.387154 19631 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:42.388779 19614 log.cc:927] Time spent T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 1.839s user 0.007s sys 0.013s
I20260204 08:59:42.359496 19626 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:42.422459 19590 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:42.449949 19623 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:42.471728 19631 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:42.518044 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 96413.6us
I20260204 08:59:42.530686 19423 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:42.531271 19423 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:42.533082 19423 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:42.495157 19626 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:42.533723 19626 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:42.535454 19626 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:42.485488 19590 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:42.513962 19631 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:42.558992 19301 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:42.571439 19301 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:42.504633 19623 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:42.602701 19513 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:42.584071 19570 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:42.602950 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:42.604136 18516 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:42.604251 19590 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:42.605717 19590 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:42.606216 19590 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:42.578382 19631 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:42.592734 19423 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:42.683817 19301 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:42.684396 19301 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:42.689464 19301 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:42.603457 19513 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:42.604056 19570 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:42.688720 19629 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:42.660153 19423 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:42.694078 19623 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:42.745535 19301 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:42.746075 19301 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:42.746475 19301 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:42.760223 19631 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:42.760569 19513 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:42.760795 19631 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:42.722954 19590 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:42.761124 19513 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:42.761482 19590 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:42.761673 19513 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:42.761979 19590 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:42.771587 18518 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.955s user 0.003s sys 0.014s
I20260204 08:59:42.765007 19301 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:43.046283 18518 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.230s user 0.012s sys 0.027s
I20260204 08:59:42.739893 19629 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:42.766376 19423 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:42.763566 19513 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:42.768002 19625 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.109473 19625 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.109983 19628 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.110613 19628 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.111290 19635 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.111544 19625 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.112399 19625 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.112459 19628 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.113021 19628 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.113511 19628 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.112870 19625 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.060099 19631 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.119345 19631 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.120594 19631 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.121677 19631 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.124569 18519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 569) took 2298 ms. Trace:
I20260204 08:59:43.125512 19631 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.128988 19631 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.129679 19631 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.132426 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.132462 19631 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.133523 19631 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.134320 19631 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.124998 18519 rpcz_store.cc:276] 0204 08:59:40.826277 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:43.123624 (+2297347us) service_pool.cc:225] Handling call
0204 08:59:43.124026 (+ 402us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:43.124213 (+ 187us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:43.124248 (+ 35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:43.124292 (+ 44us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:43.124324 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:43.124385 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:43.124509 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:43.137573 19631 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.133102 18450 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:43.138654 19631 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.139539 19631 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:42.767455 19570 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:42.932278 19590 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:42.765903 19623 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.115314 19628 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.159705 19590 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.111816 19635 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.146179 19629 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:43.289799 19050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s user 0.023s sys 0.029s
W20260204 08:59:43.291038 19050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s user 0.023s sys 0.029s
I20260204 08:59:43.313848 18518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 187) took 2481 ms. Trace:
I20260204 08:59:43.273432 19423 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.326085 19301 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.326615 19301 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.292155 19651 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.350935 19640 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.351481 19671 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.351693 19635 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.352197 19635 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.352097 19671 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.352488 19653 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.353029 19653 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.354032 19671 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.331741 19649 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.354851 19653 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.314649 18518 rpcz_store.cc:276] 0204 08:59:40.811840 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:40.815287 (+ 3447us) service_pool.cc:225] Handling call
0204 08:59:40.815589 (+ 302us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:40.815775 (+ 186us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 08:59:43.052284 (+2236509us) log.cc:844] Serialized 14 byte log entry
0204 08:59:43.292576 (+240292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:43.292628 (+ 52us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:43.292666 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:43.292727 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:43.292843 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":2470641,"threads_started":2}
W20260204 08:59:43.358012 18415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s user 0.006s sys 0.012s
W20260204 08:59:43.358331 18415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s user 0.006s sys 0.012s
I20260204 08:59:43.359503 19513 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.360042 19513 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.355770 19673 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.361547 19673 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.332285 19423 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.355630 19651 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.351509 19640 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.367795 19651 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.368324 19651 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.368922 19640 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.363509 19673 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.370812 19673 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:43.351550 19646 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.371237 19673 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.373631 19631 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.374184 19631 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.374615 19631 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.372623 19635 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.355391 19653 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.376869 19635 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.377180 19653 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.384724 19673 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.356890 19570 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.386171 19653 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.287516 19590 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:43.387283 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:43.391849 19590 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.390362 19653 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.355022 19649 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.388234 19570 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.366066 19423 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.368731 19651 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.267836 19623 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.429960 19301 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.438777 19651 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.439417 19651 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.439931 19651 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.441887 19651 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.403625 19653 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.411392 19625 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.444067 19653 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.402091 19513 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.445861 19649 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.446111 19301 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:43.447010 18343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s user 0.015s sys 0.035s
I20260204 08:59:43.446878 19301 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:43.447396 18343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s user 0.016s sys 0.036s
I20260204 08:59:43.447974 19513 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.448581 19513 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.450353 19513 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.450783 19513 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.410550 19671 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.327179 19628 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.457540 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.417500 19423 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.458655 19107 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:43.372380 19646 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.463570 19637 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.463832 19690 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.464509 19674 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.464330 19690 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.455101 19635 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.464977 19674 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.465229 19635 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.466251 19690 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.466820 19674 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.463598 19670 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.468019 19570 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.467844 19670 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.468150 19684 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.468521 19423 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.468685 19684 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.467057 19666 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.469771 19670 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.470387 19423 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.470671 19684 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.470093 19666 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.460289 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.466761 19690 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.470835 19644 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.459893 19642 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.451187 19513 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.489709 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.501931 18450 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:43.490581 19301 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.467334 19675 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.464229 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.492364 19104 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:43.505594 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.464234 19105 raft_consensus.cc:1275] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:43.506398 19655 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:43.506667 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.472136 19628 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.461138 19671 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.507282 19107 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:43.505750 19688 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.466997 19635 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.506320 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.505673 19667 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.513433 19623 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.513204 19667 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.514875 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.515117 19513 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.515457 19629 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.506155 19664 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.508637 19642 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.506842 19655 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.509296 19631 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.505587 19669 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.520305 19646 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.520563 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.510651 19687 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:43.470690 19637 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.520752 19669 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.504853 19675 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.522279 19687 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.496129 19690 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.524362 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.519039 19101 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:43.529749 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.527890 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.530452 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.531172 19655 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.517249 19664 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.532533 19690 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.514204 19688 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.534754 19688 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.533118 18343 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.537650 19666 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.538189 19687 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.503698 19644 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.537927 19655 raft_consensus.cc:2804] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:43.527812 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.543941 18442 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:43.533217 19664 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.544173 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.540581 19644 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.544883 19100 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:43.544979 19628 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.545400 19659 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.541057 19655 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.542208 19669 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.546315 19655 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:43.543162 18343 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.543406 19667 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.548437 18343 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.548611 19667 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:43.552488 19667 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.552910 19667 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:43.552551 19669 raft_consensus.cc:2804] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:43.553555 19669 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.553963 19669 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:43.555819 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.556360 19050 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.545885 19659 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.559741 19642 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.559849 19050 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.560256 19687 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:43.560663 19687 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.561796 18446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 538) took 2143 ms. Trace:
I20260204 08:59:43.562184 18446 rpcz_store.cc:276] 0204 08:59:41.418571 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:41.418703 (+ 132us) service_pool.cc:225] Handling call
0204 08:59:42.217870 (+799167us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:42.218852 (+ 982us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:43.561574 (+1342722us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54003f98d0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83ee52d 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:43.561718 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1836833280}
I20260204 08:59:43.562902 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.561120 18343 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.563982 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.564589 18442 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:43.564842 18343 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.565399 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.565896 19689 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:43.566308 19689 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.566650 19689 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.567823 19644 raft_consensus.cc:2804] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:43.568204 19644 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:43.568746 19644 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.568922 19685 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.569257 19676 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.568197 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.561025 19687 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:43.569417 19685 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.570613 19590 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:43.564533 19642 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:43.576148 19642 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.576538 19590 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.577841 19669 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.578433 19590 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.571028 19670 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.579742 19670 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.581485 19670 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.571218 19660 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:43.582070 19660 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.584890 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.586683 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.586911 19660 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.587672 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.587908 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.558802 19637 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.570269 18450 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:43.589115 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.590277 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.590571 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.569768 19676 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.585724 19628 consensus_queue.cc:1048] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260204 08:59:43.585539 18442 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:43.594682 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.596354 19676 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.596904 19101 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:43.576354 19685 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.576517 19642 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:43.601133 19659 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.601929 19671 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.603097 19050 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.605867 18343 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.607069 19301 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:43.607486 19301 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.608294 19301 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.608311 19050 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.610466 19675 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.615585 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.616892 19690 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:43.617905 19690 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.618264 19690 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.619714 19050 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.620599 19574 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:43.620954 19574 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.621294 19574 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:43.630862 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.631717 19669 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.609798 19628 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:43.638962 19628 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.640610 18373 raft_consensus.cc:1240] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:43.640986 19628 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.635434 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:43.641598 19102 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:43.631728 18444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47922 (request call id 541) took 1090 ms. Trace:
I20260204 08:59:43.642187 18444 rpcz_store.cc:276] 0204 08:59:42.540943 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:42.545466 (+ 4523us) service_pool.cc:225] Handling call
0204 08:59:43.630710 (+1085244us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:43.631672 (+ 962us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26457344}
I20260204 08:59:43.642377 19642 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:43.644409 18516 consensus_meta.cc:287] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.040s user 0.008s sys 0.013s
W20260204 08:59:43.644556 18472 debug-util.cc:398] Leaking SignalData structure 0x7b080019a260 after lost signal to thread 18234
I20260204 08:59:43.645524 18516 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:43.646059 18516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 498) took 1059 ms. Trace:
I20260204 08:59:43.646377 18516 rpcz_store.cc:276] 0204 08:59:42.587450 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:42.602589 (+ 15139us) service_pool.cc:225] Handling call
0204 08:59:43.645982 (+1043393us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 08:59:43.646486 18472 debug-util.cc:398] Leaking SignalData structure 0x7b080010d2a0 after lost signal to thread 18401
W20260204 08:59:43.647157 18472 debug-util.cc:398] Leaking SignalData structure 0x7b0800207a60 after lost signal to thread 18402
W20260204 08:59:43.648263 18472 debug-util.cc:398] Leaking SignalData structure 0x7b080009a9c0 after lost signal to thread 18475
I20260204 08:59:43.648413 19102 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:43.649549 18343 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.650506 19675 raft_consensus.cc:2804] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:43.651762 19659 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.651003 19689 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.651959 19644 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.652277 19659 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.654832 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:43.654847 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:43.655560 19105 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.653995 19659 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.660975 19655 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.661868 18518 raft_consensus.cc:1275] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:43.662918 19655 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.665040 19105 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:43.665599 19644 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.666222 19689 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.665822 19687 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.668493 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 175) took 3521 ms. Trace:
I20260204 08:59:43.668821 18524 rpcz_store.cc:276] 0204 08:59:40.146964 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:40.147313 (+ 349us) service_pool.cc:225] Handling call
0204 08:59:43.667805 (+3520492us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:43.667967 (+ 162us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:43.668119 (+ 152us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:43.668142 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:43.668176 (+ 34us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:43.668201 (+ 25us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:43.668258 (+ 57us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:43.668346 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14222720}
I20260204 08:59:43.669560 18343 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.664911 19301 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.671841 19301 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.670676 19642 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.668282 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:43.672372 19655 raft_consensus.cc:2804] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:43.671865 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:43.672758 19105 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:43.673784 19687 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.674551 19101 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:43.672885 19655 raft_consensus.cc:697] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:43.676252 19655 consensus_queue.cc:237] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.681751 19101 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:43.682811 18343 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:43.685235 19642 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:43.685701 19642 raft_consensus.cc:697] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:43.686494 19642 consensus_queue.cc:237] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.688879 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:43.689147 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:43.689684 18444 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:43.689684 18445 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.695160 19669 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.695719 19669 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.696321 18340 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.697456 19669 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:43.697953 19669 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.698369 19669 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.699486 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.699996 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.700589 18524 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:43.700659 19672 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:43.700822 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.701097 19672 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:43.701467 19672 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.701467 18517 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:43.704597 19105 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:43.704706 18444 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:43.650995 19675 raft_consensus.cc:697] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:43.718722 19675 consensus_queue.cc:237] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.702414 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:43.720074 18442 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.720500 19660 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.721074 19660 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.722886 19660 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.723332 19660 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.723776 19590 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:43.724412 18414 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.725380 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:43.725831 19666 raft_consensus.cc:2804] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:43.705281 19659 consensus_queue.cc:1048] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260204 08:59:43.726001 19676 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.708510 19669 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.708969 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.727084 19646 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 08:59:43.727957 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.728391 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:43.729041 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.729619 18523 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:43.729714 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:43.730367 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.697574 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.707468 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.731802 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.732272 18414 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.710107 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.710784 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.733034 19631 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.714668 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.733187 18414 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:43.733551 19631 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:43.727973 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:43.740526 18377 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:43.732873 19660 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.726574 19676 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:43.744725 19676 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.748500 19629 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:43.749063 19629 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.749413 19629 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:43.748646 19681 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:43.724256 19590 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.343551 19590 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:43.717818 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.707504 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.730361 18370 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:44.345268 18520 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:43.751447 19681 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.727134 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.346087 19681 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:43.784327 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:43.804193 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.711310 18372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 172) took 2892 ms. Trace:
I20260204 08:59:44.347255 18372 rpcz_store.cc:276] 0204 08:59:40.819183 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:40.820425 (+ 1242us) service_pool.cc:225] Handling call
0204 08:59:40.820715 (+ 290us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:41.344924 (+524209us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:41.344996 (+ 72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:41.379567 (+ 34571us) log.cc:844] Serialized 26 byte log entry
0204 08:59:42.058288 (+678721us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:42.197118 (+138830us) log.cc:844] Serialized 14 byte log entry
0204 08:59:42.233326 (+ 36208us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:42.233396 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:43.711098 (+1477702us) raft_consensus.cc:1685] finished
0204 08:59:43.711118 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:43.711238 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1432256,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":1099473,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":1833,"thread_start_us":1340125,"threads_started":4,"wal-append.queue_time_us":2020750}
I20260204 08:59:43.715262 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:43.829761 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:43.830010 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.349911 18375 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:43.829591 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:43.709926 18491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.982s user 0.001s sys 0.038s
W20260204 08:59:43.833355 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 85100.7us
I20260204 08:59:43.716260 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:44.350804 18491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.624s user 0.002s sys 0.038s
I20260204 08:59:44.351064 18450 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:43.851701 18524 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:43.924938 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:43.960927 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 92790.3us
I20260204 08:59:43.977752 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:43.761315 19666 raft_consensus.cc:697] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:44.654986 19666 consensus_queue.cc:237] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:43.834277 19653 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.660795 19653 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:43.831876 19660 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:44.669207 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 317023us
W20260204 08:59:44.670192 18417 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.3.193:33867 timed out after 1.539s (SENT) [suppressed 50 similar messages]
I20260204 08:59:43.720609 19671 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:43.842941 19672 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.672158 19646 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:44.672556 19649 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:44.672631 19646 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.673094 19649 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:44.673451 19672 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:43.735476 19631 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:43.773921 19629 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.153741 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.684326 18196 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47988 (request call id 240) took 4588 ms. Trace:
I20260204 08:59:44.684660 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:44.685891 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.176941 18442 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:44.160038 18445 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:44.260504 19685 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:44.686834 19685 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.687173 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.687724 18451 raft_consensus.cc:1240] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:43.709900 18343 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:44.297969 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.690876 18522 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:44.691773 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.692087 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.692778 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.693831 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:44.328461 19690 consensus_meta.cc:287] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.710s user 0.006s sys 0.007s
I20260204 08:59:43.717418 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.354168 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.694671 18449 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:44.694518 19690 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:44.695207 18449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39114 (request call id 238) took 1207 ms. Trace:
I20260204 08:59:44.357801 19681 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.372727 19590 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:44.695741 18449 rpcz_store.cc:276] 0204 08:59:43.487794 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:43.488978 (+ 1184us) service_pool.cc:225] Handling call
0204 08:59:43.717294 (+228316us) spinlock_profiling.cc:243] Waited 910 us on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb53040dc 00007fceb5303c9b 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:44.695151 (+977857us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2124928}
I20260204 08:59:44.696635 19690 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:44.506281 19698 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.696941 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:44.697431 19681 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:44.697235 19698 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.358771 19676 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.697832 18451 raft_consensus.cc:2393] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:44.698128 19676 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.699136 19698 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:44.512092 18341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.992s user 0.028s sys 0.028s
I20260204 08:59:44.512763 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 501) took 1757 ms. Trace:
I20260204 08:59:44.700845 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.511333 19697 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.701907 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.702237 19697 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:44.516880 19694 log.cc:927] Time spent T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.140s user 0.001s sys 0.000s
I20260204 08:59:44.519083 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.700934 18525 rpcz_store.cc:276] 0204 08:59:42.751080 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:43.713500 (+962420us) service_pool.cc:225] Handling call
0204 08:59:44.508135 (+794635us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb530412e 000000000035a3c9 00007fcebd336560 00007fcebd3fedd4 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:44.508441 (+ 306us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:44.508580 (+ 139us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:44.508595 (+ 15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:44.508623 (+ 28us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:44.508640 (+ 17us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:44.508675 (+ 35us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:44.508765 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2864128}
I20260204 08:59:44.695822 19672 raft_consensus.cc:2804] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:44.703747 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.704027 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.704291 18523 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:44.519421 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.519954 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.705103 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:44.705386 18518 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:44.705471 18521 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:44.706127 19697 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:44.524047 19050 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.706321 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.705119 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.524914 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:44.706849 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 182864us
I20260204 08:59:44.707417 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:44.525679 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.526412 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:44.530854 19574 consensus_meta.cc:287] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.909s user 0.005s sys 0.018s
I20260204 08:59:44.563055 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.564145 19100 raft_consensus.cc:1240] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:44.565538 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.565819 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.566570 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:44.573351 19667 consensus_meta.cc:287] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 1.020s user 0.010s sys 0.010s
I20260204 08:59:44.581693 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:44.590402 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:44.595480 19675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s user 0.019s sys 0.017s
I20260204 08:59:44.599291 19099 raft_consensus.cc:1240] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
W20260204 08:59:44.610064 19628 consensus_meta.cc:287] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.954s user 0.008s sys 0.009s
I20260204 08:59:44.614563 18340 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:44.621301 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.627087 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:44.631961 19102 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.955s user 0.023s sys 0.013s
W20260204 08:59:44.633855 19692 log.cc:927] Time spent T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.262s user 0.001s sys 0.001s
W20260204 08:59:44.634940 18472 debug-util.cc:398] Leaking SignalData structure 0x7b08002c90e0 after lost signal to thread 18549
I20260204 08:59:44.637656 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.640141 19107 raft_consensus.cc:1240] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:44.650440 18197 catalog_manager.cc:5654] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } }
I20260204 08:59:44.652132 18198 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54546 (request call id 123) took 4521 ms. Trace:
I20260204 08:59:44.661819 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.662849 19653 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:44.667073 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.670359 18414 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.671353 19671 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.673851 19428 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.674630 19646 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:44.674907 19649 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:44.683478 19629 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:44.684725 18196 rpcz_store.cc:276] 0204 08:59:40.095861 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:40.096020 (+ 159us) service_pool.cc:225] Handling call
0204 08:59:40.748001 (+651981us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b5400003610. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb53042f2 00007fcebe217e99 00007fcebe1afe76 00007fcebe180d68 00007fcebe27b10e 00007fcebc7764a4 00007fcebc776432 00007fcebc776361 00007fcebc7762dc
0204 08:59:44.684175 (+3936174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2282454,"reported_tablets":2,"spinlock_wait_cycles":7032576}
I20260204 08:59:44.688387 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.687096 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.688699 19685 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:44.708068 19050 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.745379 19101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46720 (request call id 573) took 1040 ms. Trace:
I20260204 08:59:44.745103 19667 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.745712 19623 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:44.745877 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.746426 19623 raft_consensus.cc:697] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:44.746687 18369 raft_consensus.cc:1240] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:44.747694 18442 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:44.747483 19428 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.748673 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.749333 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.748579 18369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 842) took 1350 ms. Trace:
I20260204 08:59:44.703909 19672 raft_consensus.cc:697] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:44.695168 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:44.701838 18341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.192s user 0.029s sys 0.029s
I20260204 08:59:44.750833 19646 raft_consensus.cc:2804] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:44.751209 19646 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:44.751374 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.751583 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:44.751614 19646 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:44.355098 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.752151 18377 raft_consensus.cc:3055] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:44.752558 18377 raft_consensus.cc:740] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:44.707963 19423 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:44.696383 19590 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.752935 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.753232 18377 consensus_queue.cc:260] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.754145 18377 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.754426 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.754702 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.755793 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.755975 18524 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
I20260204 08:59:44.747285 19623 consensus_queue.cc:237] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.757515 18450 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:44.758479 18450 raft_consensus.cc:1240] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
W20260204 08:59:44.750530 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 80226.5us
I20260204 08:59:44.759519 18522 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:44.760442 19590 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:44.750162 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.761444 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.762542 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.763335 18198 rpcz_store.cc:276] 0204 08:59:40.130657 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:40.130803 (+ 146us) service_pool.cc:225] Handling call
0204 08:59:44.652037 (+4521234us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":632074,"reported_tablets":3}
I20260204 08:59:44.763578 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.706200 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.767865 19672 consensus_queue.cc:237] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:44.748580 19050 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.768841 19642 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:44.747313 19574 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:44.769495 19690 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:44.770035 19690 raft_consensus.cc:697] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:44.770159 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.770678 19574 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:44.757232 18443 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:44.771265 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.760934 18414 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.786350 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.786763 19649 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:44.787199 19649 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.787544 19649 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:44.767361 18448 raft_consensus.cc:1240] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:44.790437 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.792073 18414 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:44.510469 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 134514us
I20260204 08:59:44.793681 19629 raft_consensus.cc:2804] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:44.794034 19629 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:44.794364 19629 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.795053 19590 consensus_queue.cc:1059] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:44.796267 19685 raft_consensus.cc:3055] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:44.796607 19685 raft_consensus.cc:740] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:44.797367 19685 consensus_queue.cc:260] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.798313 19685 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:44.799365 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.766923 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:44.756879 19102 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.080s user 0.024s sys 0.017s
I20260204 08:59:44.707677 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.767408 19646 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.819591 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.819790 18414 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.820387 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.820749 19646 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:44.821692 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.766110 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.822564 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.823014 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.823174 18520 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:44.753497 19423 raft_consensus.cc:697] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:44.824340 19423 consensus_queue.cc:237] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.765204 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:44.827723 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.828150 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.699836 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.749495 19428 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:44.770887 19690 consensus_queue.cc:237] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.828446 18520 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:44.828930 18523 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:44.827782 19649 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.830767 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.772413 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.831769 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.832151 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.832811 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.702549 18449 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:44.831442 19649 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:44.747165 19667 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:44.768508 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 153995us
I20260204 08:59:44.832733 19105 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:44.756925 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.833948 19102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 572) took 1158 ms. Trace:
I20260204 08:59:44.834084 18340 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.752020 18447 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:44.775856 18373 raft_consensus.cc:1275] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:44.775319 18450 raft_consensus.cc:1240] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:44.756948 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.776039 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.745769 19101 rpcz_store.cc:276] 0204 08:59:43.704746 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:43.705704 (+ 958us) service_pool.cc:225] Handling call
0204 08:59:44.745285 (+1039581us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:44.834956 18451 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
W20260204 08:59:44.772608 18472 debug-util.cc:398] Leaking SignalData structure 0x7b0800118cc0 after lost signal to thread 18550
I20260204 08:59:44.836581 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.836670 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:44.837064 18472 debug-util.cc:398] Leaking SignalData structure 0x7b0800327c60 after lost signal to thread 19135
I20260204 08:59:44.837273 19099 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 1.
I20260204 08:59:44.837764 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.838722 18340 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:44.755483 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:44.834586 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.834312 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.841670 19105 raft_consensus.cc:1240] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:44.747159 19671 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:44.749863 18369 rpcz_store.cc:276] 0204 08:59:43.397719 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:43.618841 (+221122us) service_pool.cc:225] Handling call
0204 08:59:43.619130 (+ 289us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:44.747082 (+1127952us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:44.748325 (+ 1243us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400463554. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:44.748501 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2592702208}
I20260204 08:59:44.781777 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.841611 19100 raft_consensus.cc:1240] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:44.782285 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.843242 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.780834 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.844365 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.783284 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.835513 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.845479 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.845597 18373 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:44.845943 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.846514 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.846616 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.782912 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.847277 18371 raft_consensus.cc:1240] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:44.847672 18368 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:44.847810 18373 raft_consensus.cc:1240] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
W20260204 08:59:44.784600 19675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.055s user 0.021s sys 0.019s
I20260204 08:59:44.847230 18370 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:44.844983 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.784960 19628 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.849972 18491 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:44.850728 19642 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:44.850667 19628 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:44.853616 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:44.690882 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 980985us
I20260204 08:59:44.855005 18340 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:44.699946 19676 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:44.856096 19628 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:44.858152 18340 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:44.811035 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.817514 18488 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:44.690099 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:44.861838 19676 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:44.863718 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.864240 19100 raft_consensus.cc:1275] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:44.832888 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.779814 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.865686 18372 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:44.834355 19102 rpcz_store.cc:276] 0204 08:59:43.675746 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:43.675964 (+ 218us) service_pool.cc:225] Handling call
0204 08:59:43.676257 (+ 293us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:43.676455 (+ 198us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 08:59:44.818756 (+1142301us) log.cc:844] Serialized 14 byte log entry
0204 08:59:44.833254 (+ 14498us) log.cc:844] Serialized 14 byte log entry
0204 08:59:44.833610 (+ 356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:44.833660 (+ 50us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:44.833707 (+ 47us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:44.833770 (+ 63us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:44.833879 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":671239,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":143,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"thread_start_us":1155491,"threads_started":2,"wal-append.queue_time_us":12642}
I20260204 08:59:44.842744 18376 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
W20260204 08:59:44.843909 18472 debug-util.cc:398] Leaking SignalData structure 0x7b0800230fc0 after lost signal to thread 19136
I20260204 08:59:44.834895 19667 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:44.866200 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:44.866829 19667 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:44.867255 19667 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:44.809562 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 61063.9us
I20260204 08:59:44.765910 18377 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:44.868022 19050 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.868794 19574 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:44.869145 19574 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:44.869485 19574 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:44.870544 18446 raft_consensus.cc:1240] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:44.871801 19671 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:44.872179 19671 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:44.872520 19671 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:44.874270 18343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:44.707832 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.879808 19104 raft_consensus.cc:1240] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:44.884274 19628 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:44.885926 19623 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:44.885747 19574 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.886425 19623 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:44.886271 19667 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.887768 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:44.888345 19623 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:44.888476 19667 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:44.889345 18340 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:44.890820 19675 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:44.894733 19100 raft_consensus.cc:1240] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:44.897019 19099 raft_consensus.cc:1240] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:44.899757 18444 raft_consensus.cc:1240] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:44.901242 19574 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:44.902555 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:44.906144 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 103610us
I20260204 08:59:44.906802 19629 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.909089 19629 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:44.911440 19099 raft_consensus.cc:1275] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:44.907423 18488 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:44.912469 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:44.912726 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 44128.2us
I20260204 08:59:44.913079 19685 raft_consensus.cc:2749] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:44.914546 18488 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:44.915138 19697 consensus_queue.cc:1059] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:44.915467 19685 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:44.915902 19685 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.915967 19697 consensus_queue.cc:1243] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer 354a648f08a44b98a7f93d74b0ea93ab log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260204 08:59:44.916375 19685 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.915571 18488 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:44.916862 19590 raft_consensus.cc:3055] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:44.917032 19642 consensus_queue.cc:1048] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:44.917786 19651 consensus_queue.cc:1059] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:44.918726 19644 raft_consensus.cc:3055] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:44.917708 19590 raft_consensus.cc:740] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:44.919806 18488 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:44.920084 19590 consensus_queue.cc:260] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.920571 19698 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:44.921047 19698 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:44.921114 19628 consensus_queue.cc:1059] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:44.919009 19697 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:44.921576 19698 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:44.922119 19642 raft_consensus.cc:3055] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:44.922482 19642 raft_consensus.cc:740] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:44.923203 19642 consensus_queue.cc:260] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:44.924556 19642 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.924892 19628 consensus_queue.cc:1048] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:44.919047 19644 raft_consensus.cc:740] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:44.923316 19685 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.926604 19644 consensus_queue.cc:260] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:44.927433 19685 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:44.927891 19644 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:44.927346 18340 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:44.930445 19628 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:44.930809 19628 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.931170 18488 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:44.931950 19685 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:44.930629 19698 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.934116 19698 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:44.931176 19628 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.921296 19590 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.921885 19697 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:44.936365 19697 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:44.944922 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:44.945639 18442 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.935832 19698 consensus_queue.cc:1059] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260204 08:59:44.948881 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:44.952117 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:44.949463 18516 raft_consensus.cc:1240] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:44.952721 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:44.952695 18518 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:44.953958 19423 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:44.954558 19423 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.949972 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.956228 19698 raft_consensus.cc:3055] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:44.956521 19423 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:44.950182 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:44.956962 18340 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.962486 18518 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:44.963201 18519 raft_consensus.cc:1240] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:44.960844 19698 raft_consensus.cc:740] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:44.965873 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.968215 19698 consensus_queue.cc:260] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:44.969535 19101 raft_consensus.cc:1240] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:44.969596 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.970041 19649 consensus_queue.cc:1059] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:44.982897 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.983546 18518 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:44.970785 18417 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:44.971989 18491 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:44.972949 19671 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:44.979303 19666 consensus_queue.cc:1059] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:44.980913 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.981056 19697 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:44.969674 19050 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:44.985235 19667 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:44.985678 18340 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:44.986164 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.994863 18520 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:44.994943 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:44.986601 19644 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:44.995610 18340 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:44.995963 19644 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:44.996443 19675 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:44.996743 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:44.996847 19675 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:44.996939 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:44.997329 19675 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:44.995769 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:44.997604 18377 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:44.997933 18523 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.996373 19644 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:44.999963 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.000535 18377 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:44.987528 19671 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:44.989655 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.004029 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:44.990944 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.992363 19428 raft_consensus.cc:3055] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:44.992501 19629 raft_consensus.cc:3055] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:45.006228 19629 raft_consensus.cc:740] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:45.010681 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.008249 18414 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.993790 19050 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.012297 18417 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.013736 18417 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:44.992995 19676 consensus_queue.cc:1059] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260204 08:59:45.015439 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:45.016186 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.017876 18414 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:45.018992 18417 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.020682 18414 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.022105 18414 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:44.991575 18517 raft_consensus.cc:1240] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:44.994886 19642 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:44.992437 19697 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:45.020587 19681 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:44.991025 19666 raft_consensus.cc:2749] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.038904 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.021626 19637 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:45.039526 19637 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:45.039912 19637 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:44.993263 19690 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:44.992877 19685 raft_consensus.cc:2749] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:45.005879 19428 raft_consensus.cc:740] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:45.051478 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.023725 19631 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.052747 19631 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:45.053143 19631 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.053826 19428 consensus_queue.cc:260] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:45.054829 19428 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:44.989061 19698 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:45.028586 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.030467 19629 consensus_queue.cc:260] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:45.023439 19623 raft_consensus.cc:2749] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.023368 19652 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.028683 18375 raft_consensus.cc:1240] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:45.028484 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:44.994102 19667 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:45.028642 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.033617 19653 raft_consensus.cc:2804] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:45.062925 19667 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:45.063195 19653 raft_consensus.cc:697] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:45.050392 19644 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.064222 19653 consensus_queue.cc:237] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.019621 19649 consensus_queue.cc:1059] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260204 08:59:45.020246 19633 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:44.993470 19660 consensus_queue.cc:1059] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260204 08:59:45.036653 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.037817 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.037911 18523 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:45.038336 19646 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:45.071163 19646 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:45.071573 19646 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:45.072391 19649 raft_consensus.cc:3055] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:45.072772 19649 raft_consensus.cc:740] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:45.073454 19649 consensus_queue.cc:260] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:45.039028 19676 consensus_queue.cc:1243] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer 354a648f08a44b98a7f93d74b0ea93ab log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260204 08:59:45.074529 19649 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.067732 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.040597 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:45.064281 18546 debug-util.cc:398] Leaking SignalData structure 0x7b08000ef9a0 after lost signal to thread 15378
I20260204 08:59:45.075899 18374 raft_consensus.cc:2376] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3. Re-sending same reply.
I20260204 08:59:45.006832 19675 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:45.076930 18546 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5080 after lost signal to thread 18234
W20260204 08:59:45.078164 18546 debug-util.cc:398] Leaking SignalData structure 0x7b0800331460 after lost signal to thread 18401
W20260204 08:59:45.078469 18546 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7d80 after lost signal to thread 18402
I20260204 08:59:45.029628 19642 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:45.067155 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:45.075832 19660 consensus_queue.cc:1243] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer 354a648f08a44b98a7f93d74b0ea93ab log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260204 08:59:45.078905 19697 raft_consensus.cc:3055] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:45.079731 19697 raft_consensus.cc:740] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:45.080528 19697 consensus_queue.cc:260] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.078985 19642 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.079346 19101 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:45.082993 19675 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:45.083479 18343 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:45.085166 19651 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:45.085510 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:45.085515 19651 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:45.086840 19651 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:45.067700 19644 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:45.023023 19050 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:45.056617 18442 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
W20260204 08:59:45.087838 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 64887.7us
I20260204 08:59:45.089630 19050 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:45.089869 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.090399 19050 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:45.081460 19676 raft_consensus.cc:3055] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:45.091387 19050 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.091605 19676 raft_consensus.cc:740] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:45.092396 19676 consensus_queue.cc:260] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.092867 19050 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:45.093488 19676 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:45.093855 19623 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.094630 19301 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:45.094975 19301 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:45.095285 19301 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
W20260204 08:59:45.079488 18546 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa200 after lost signal to thread 18475
I20260204 08:59:45.081635 19697 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.095721 18340 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.081519 19629 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:45.100838 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.096078 19050 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:45.113199 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.115417 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.116901 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.116976 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.094285 19623 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:45.118450 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 96402.2us
W20260204 08:59:45.096720 18546 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef200 after lost signal to thread 18476
I20260204 08:59:45.099710 19690 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:45.120079 19642 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:45.097584 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.123234 19690 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:45.123679 19690 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:45.127578 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.121063 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.136571 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.120644 19623 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.113687 19644 raft_consensus.cc:2749] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:45.128839 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.101202 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.097971 19423 raft_consensus.cc:2749] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.114966 19631 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.098048 19574 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:45.143288 19301 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:45.144573 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.146136 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.146289 18375 raft_consensus.cc:1240] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:45.146489 19106 raft_consensus.cc:1240] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:45.146746 18374 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 1.
W20260204 08:59:45.147507 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 128547us
I20260204 08:59:45.148300 18446 raft_consensus.cc:1240] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:45.149230 19631 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:45.150542 18525 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:45.151998 18517 raft_consensus.cc:1240] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:45.144121 19428 consensus_queue.cc:1059] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260204 08:59:45.153436 19633 raft_consensus.cc:3055] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 08:59:45.153760 19633 raft_consensus.cc:740] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:45.148211 19590 consensus_queue.cc:1059] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260204 08:59:45.154733 19590 raft_consensus.cc:3055] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:45.154567 19633 consensus_queue.cc:260] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.155119 19590 raft_consensus.cc:740] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:45.156090 19633 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:45.155900 19590 consensus_queue.cc:260] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.157012 19590 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:45.141433 18414 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:45.152024 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.194902 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.200238 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.195422 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.144153 19574 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:45.207175 18415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:45.160490 18417 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:45.209260 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 67904us
W20260204 08:59:45.162068 18546 debug-util.cc:398] Leaking SignalData structure 0x7b08000929e0 after lost signal to thread 18549
I20260204 08:59:45.226502 19727 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:45.227125 19727 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:45.229647 19301 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:45.230393 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 134422us
I20260204 08:59:45.232172 18376 raft_consensus.cc:1240] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:45.218523 19690 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.234624 19690 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:45.236299 18521 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:45.209837 19423 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260204 08:59:45.223577 18546 debug-util.cc:398] Leaking SignalData structure 0x7b080019cba0 after lost signal to thread 18550
I20260204 08:59:45.210004 19681 raft_consensus.cc:2804] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
W20260204 08:59:45.245831 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 92504.7us
I20260204 08:59:45.246583 18417 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.210237 19574 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
W20260204 08:59:45.248941 18488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:45.243667 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.251964 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.252568 18372 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:45.256484 18488 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.253366 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.257051 18374 raft_consensus.cc:1240] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:45.261967 18488 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:45.241649 18445 raft_consensus.cc:1240] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:45.241899 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.263737 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.242403 19642 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:45.265096 18372 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:45.265748 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.247381 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.242599 19423 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:45.235904 19628 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:45.250384 19631 raft_consensus.cc:2749] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.267165 18372 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:45.263861 18488 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.267513 18374 raft_consensus.cc:1240] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:45.265635 18414 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.243606 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:45.251516 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.264707 19671 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.266168 19660 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.279342 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.308045 18377 raft_consensus.cc:2393] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 3: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:45.308044 18414 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 08:59:45.309208 18489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:45.312059 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.312635 18375 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:45.275197 19423 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:45.313156 18370 raft_consensus.cc:1240] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:45.313661 19099 raft_consensus.cc:1240] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:45.314354 18370 raft_consensus.cc:1240] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:45.279284 19428 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.316789 18524 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:45.304013 18488 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.270505 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.302197 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.302194 18520 raft_consensus.cc:1275] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:45.323616 18414 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.312577 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.312515 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:45.302256 18546 debug-util.cc:398] Leaking SignalData structure 0x7b0800229d20 after lost signal to thread 19135
I20260204 08:59:45.320748 19675 consensus_queue.cc:1059] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:45.327306 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.327899 18517 raft_consensus.cc:1275] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:45.324163 18375 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 08:59:45.329950 19428 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 08:59:45.330195 19719 log.cc:927] Time spent T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.135s user 0.002s sys 0.000s
I20260204 08:59:45.279687 19677 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.325203 18414 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:45.325382 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 78886.5us
I20260204 08:59:45.331441 18417 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.318859 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.333259 18417 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.339347 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.342844 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.324440 19666 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.307240 19660 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 08:59:45.326071 18546 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6dc0 after lost signal to thread 19136
W20260204 08:59:45.350632 19717 log.cc:927] Time spent T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.206s user 0.001s sys 0.000s
I20260204 08:59:45.351262 19106 raft_consensus.cc:1240] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:45.348089 19698 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.351930 19698 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:45.352285 19698 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.351008 19574 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:45.324645 19676 raft_consensus.cc:2749] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:45.353535 18489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:45.349444 18417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:45.324848 19631 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 08:59:45.354393 18417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:45.357574 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:45.343300 19649 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.355129 19660 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.350850 19646 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.368358 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.348456 19721 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.349012 19666 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 08:59:45.363675 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 132388us
I20260204 08:59:45.364007 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.320101 19637 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.365612 18414 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:45.366672 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.371971 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.372236 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.376809 18414 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.377104 18375 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:45.378080 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.379235 19721 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:45.380105 19697 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:45.380584 19697 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.381290 19646 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:45.381837 19646 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.382393 19697 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:45.366669 19574 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:45.367921 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:45.368161 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.377979 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:45.387482 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 163091us
I20260204 08:59:45.366823 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:45.402243 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.409569 18376 raft_consensus.cc:2393] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 2: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:45.387691 18451 raft_consensus.cc:1275] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260204 08:59:45.374637 18546 debug-util.cc:398] Leaking SignalData structure 0x7b0800111180 after lost signal to thread 19657
I20260204 08:59:45.359618 19652 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.375551 18488 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.373081 19727 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:45.366417 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.377506 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:45.409943 18451 pending_rounds.cc:85] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903: Aborting all ops after (but not including) 1
I20260204 08:59:45.423110 18451 pending_rounds.cc:107] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260204 08:59:45.359686 19681 raft_consensus.cc:697] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 08:59:45.428638 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 49969us
I20260204 08:59:45.409715 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:45.366163 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:45.379403 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.433630 18371 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:45.415247 18488 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.435366 18488 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.408442 18414 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.435803 18197 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48004 (request call id 207) took 4618 ms. Trace:
I20260204 08:59:45.416489 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.436604 19099 raft_consensus.cc:1240] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:45.416682 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:45.416927 19697 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.408195 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:45.376629 19666 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:45.423341 18340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:45.423400 18451 raft_consensus.cc:2889] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:45.388087 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.402122 19721 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:45.430176 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.439016 18488 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.439316 19050 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:45.436760 18414 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:45.444775 18414 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:45.445253 19301 raft_consensus.cc:2764] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260204 08:59:45.446954 19649 raft_consensus.cc:2764] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260204 08:59:45.447321 18414 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:45.448128 19649 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:45.448518 19649 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:45.448833 19649 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:45.449716 18414 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.450512 19633 raft_consensus.cc:2749] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.428368 19628 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:45.451596 18374 raft_consensus.cc:2393] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 3: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:45.435961 19676 raft_consensus.cc:2749] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.457302 19697 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.442528 19685 raft_consensus.cc:2749] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.460759 18449 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 08:59:45.463984 18414 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.464116 18449 raft_consensus.cc:1240] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:45.466238 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:45.466504 19651 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:45.445672 19631 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.424912 19623 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:45.445084 19721 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:45.471292 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.471781 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:45.477131 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.478525 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.479069 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.480611 18519 raft_consensus.cc:1240] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:45.470188 19633 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:45.467600 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:45.472891 18373 raft_consensus.cc:1240] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:45.474287 18368 raft_consensus.cc:1240] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:45.474577 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.475064 19671 raft_consensus.cc:2749] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.453799 19729 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.489341 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:45.493053 18340 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.494508 18447 raft_consensus.cc:1275] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:45.495167 19675 consensus_queue.cc:1059] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:45.495684 18445 raft_consensus.cc:1275] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:45.508170 18521 raft_consensus.cc:1275] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:45.525842 18523 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:45.495935 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:45.490443 19099 raft_consensus.cc:1240] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:45.496624 19637 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:45.496973 19101 raft_consensus.cc:1240] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:45.497324 19698 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.436164 18197 rpcz_store.cc:276] 0204 08:59:40.817641 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:40.818133 (+ 492us) service_pool.cc:225] Handling call
0204 08:59:45.435750 (+4617617us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 08:59:44.903403 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 08:59:44.903960 (+ 557us) write_op.cc:432] Acquiring schema lock in shared mode
0204 08:59:44.903993 (+ 33us) write_op.cc:435] Acquired schema lock
0204 08:59:44.904013 (+ 20us) tablet.cc:660] Decoding operations
0204 08:59:44.904325 (+ 312us) write_op.cc:620] Acquiring the partition lock for write op
0204 08:59:44.904392 (+ 67us) write_op.cc:641] Partition lock acquired for write op
0204 08:59:44.904424 (+ 32us) tablet.cc:683] Acquiring locks for 1 operations
0204 08:59:44.904606 (+ 182us) tablet.cc:699] Row locks acquired
0204 08:59:44.904623 (+ 17us) write_op.cc:260] PREPARE: finished
0204 08:59:44.904740 (+ 117us) write_op.cc:270] Start()
0204 08:59:44.904843 (+ 103us) write_op.cc:276] Timestamp: P: 1770195584904703 usec, L: 0
0204 08:59:44.904861 (+ 18us) op_driver.cc:348] REPLICATION: starting
0204 08:59:44.905455 (+ 594us) log.cc:844] Serialized 537 byte log entry
0204 08:59:45.144710 (+239255us) op_driver.cc:464] REPLICATION: finished
0204 08:59:45.323823 (+179113us) write_op.cc:301] APPLY: starting
0204 08:59:45.323908 (+ 85us) tablet.cc:1365] starting BulkCheckPresence
0204 08:59:45.323998 (+ 90us) tablet.cc:1368] finished BulkCheckPresence
0204 08:59:45.324102 (+ 104us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 08:59:45.324346 (+ 244us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 08:59:45.324492 (+ 146us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0204 08:59:45.324535 (+ 43us) write_op.cc:312] APPLY: finished
0204 08:59:45.358865 (+ 34330us) log.cc:844] Serialized 22 byte log entry
0204 08:59:45.372683 (+ 13818us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:45.376380 (+ 3697us) write_op.cc:454] Released schema lock
0204 08:59:45.387734 (+ 11354us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":159811,"apply.run_cpu_time_us":2044,"apply.run_wall_time_us":99108,"num_ops":1,"prepare.queue_time_us":144338,"prepare.run_cpu_time_us":7613,"prepare.run_wall_time_us":105671,"raft.queue_time_us":91664,"raft.run_cpu_time_us":28392,"raft.run_wall_time_us":157186,"replication_time_us":215940,"thread_start_us":350097,"threads_started":4,"wal-append.queue_time_us":103550}]]}
I20260204 08:59:45.499807 18376 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:45.492290 19631 consensus_queue.cc:1048] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260204 08:59:45.490289 18446 raft_consensus.cc:1275] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:45.508025 19729 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:45.491386 19651 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:45.535777 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 96818.2us
I20260204 08:59:45.485116 19732 consensus_queue.cc:1059] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260204 08:59:45.501704 19623 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:45.502727 18520 raft_consensus.cc:1275] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:45.540613 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:45.532152 19628 raft_consensus.cc:2749] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.542606 18488 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:45.533896 18519 raft_consensus.cc:1275] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:45.534893 19729 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.487846 19738 consensus_queue.cc:1059] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260204 08:59:45.542538 19661 raft_consensus.cc:3055] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:45.549253 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.550885 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.551044 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.532318 19642 consensus_queue.cc:1059] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260204 08:59:45.531338 19660 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.542084 19675 consensus_queue.cc:1243] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer c61e83e5fb7445e8bce7eca695977903 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260204 08:59:45.541936 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:45.529573 19681 consensus_queue.cc:237] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.579813 19628 consensus_queue.cc:1059] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:45.552000 19685 consensus_queue.cc:1059] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260204 08:59:45.554054 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:45.555850 18340 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.582046 18340 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.547952 18488 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.556247 18369 raft_consensus.cc:1275] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:45.558069 19666 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:45.560063 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.561271 19698 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:45.561762 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.562426 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.562824 19423 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:45.566403 19661 raft_consensus.cc:740] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 08:59:45.593837 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 45961.7us
I20260204 08:59:45.573220 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.573346 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.575037 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.546849 19671 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.586961 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:45.587399 19675 raft_consensus.cc:3055] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:45.594400 18373 raft_consensus.cc:2393] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 3: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:45.596024 19697 raft_consensus.cc:2749] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.596551 18449 raft_consensus.cc:1240] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:45.595875 19698 raft_consensus.cc:3055] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:45.600919 19735 consensus_queue.cc:1059] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:45.611258 19698 raft_consensus.cc:740] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:45.612145 19698 consensus_queue.cc:260] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:45.597438 19666 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:45.597923 19423 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:45.598209 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:45.571812 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 83065.4us
I20260204 08:59:45.601871 18488 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:45.589262 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.605196 19108 raft_consensus.cc:1240] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:45.590590 19739 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.609122 19741 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:45.609503 19661 consensus_queue.cc:260] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.674036 19050 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.675559 19649 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:45.676554 19637 raft_consensus.cc:3055] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:45.686728 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:45.608325 19671 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 08:59:45.688122 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 86363.5us
I20260204 08:59:45.608770 19675 raft_consensus.cc:740] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:45.695124 18488 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:45.695906 19720 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.696344 19720 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:45.696696 19720 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.696910 18488 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.697893 19740 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:45.698318 19740 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:45.698670 19740 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.699492 18488 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.699817 19697 consensus_queue.cc:1059] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:45.700524 19677 consensus_queue.cc:1059] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:45.700716 18488 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:45.700297 19590 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:45.701568 19677 raft_consensus.cc:3055] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:45.701066 19700 raft_consensus.cc:2749] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:45.702630 19685 raft_consensus.cc:3055] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:45.703106 19685 raft_consensus.cc:740] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:45.701829 19590 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:45.704161 19590 raft_consensus.cc:697] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:45.703943 19685 consensus_queue.cc:260] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.705219 19685 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.704995 19590 consensus_queue.cc:237] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.701944 19677 raft_consensus.cc:740] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:45.712462 19677 consensus_queue.cc:260] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:45.713744 19677 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:45.719501 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 130314us
I20260204 08:59:45.720369 18340 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.687539 19739 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:45.725103 19050 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.725900 19301 raft_consensus.cc:2749] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:45.690680 19423 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:45.734643 18340 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.737134 19725 consensus_queue.cc:1059] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260204 08:59:45.716156 19671 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:45.690907 19637 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:45.754572 18340 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.756289 18340 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.757511 19741 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:45.758711 19741 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.759698 19741 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260204 08:59:45.765129 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 64474.2us
I20260204 08:59:45.739375 19423 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:45.767479 18488 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.725148 19739 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:45.771307 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 44554.9us
I20260204 08:59:45.738421 19644 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:45.773013 18488 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.735841 18371 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:45.719408 19623 consensus_queue.cc:1059] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260204 08:59:45.872469 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 116242us
W20260204 08:59:45.873538 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 100601us
I20260204 08:59:45.874612 19050 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.766074 19423 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:45.764712 19661 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:45.884022 18340 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.885026 18488 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.886618 19050 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.887108 18340 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.888345 18340 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.889381 18340 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.871198 19700 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.884061 19590 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260204 08:59:45.904036 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 421208us
I20260204 08:59:45.914521 19050 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.942220 19050 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.942618 18414 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.893800 19660 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:45.910426 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:45.945624 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:45.945806 19751 raft_consensus.cc:2749] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.948450 18414 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.940488 19738 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.985845 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:45.984853 19755 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.917310 19746 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:45.947456 19727 raft_consensus.cc:2749] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:45.985667 19722 raft_consensus.cc:2749] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 08:59:45.993563 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 108577us
I20260204 08:59:45.896277 19637 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:45.913866 19700 raft_consensus.cc:2749] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260204 08:59:45.990607 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 48452.5us
I20260204 08:59:45.915464 19646 consensus_queue.cc:1059] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260204 08:59:45.990811 18414 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:45.952363 19730 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260204 08:59:45.988803 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 99503.5us
I20260204 08:59:45.994678 18488 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:45.909525 19720 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:46.002254 19050 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:46.007747 18340 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.982738 19649 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.009846 18488 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:46.010250 18340 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:46.011423 18414 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:45.992740 19732 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:46.018333 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 435473us
I20260204 08:59:46.012497 19099 raft_consensus.cc:2393] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 2: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
W20260204 08:59:46.024283 18489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:46.028601 18340 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:46.012847 19746 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:46.016304 19751 raft_consensus.cc:2749] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:46.033989 18340 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:46.025511 19681 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:46.046211 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.046466 19723 consensus_queue.cc:1048] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260204 08:59:46.047605 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 45512.8us
I20260204 08:59:46.069749 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:46.027931 19637 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:46.071673 19050 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:46.048866 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:46.021086 19700 raft_consensus.cc:2749] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:46.077764 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:46.027586 19697 raft_consensus.cc:2749] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.047518 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:46.036602 19738 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.036396 19755 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 1 FOLLOWER]: Advancing to term 2
W20260204 08:59:46.091826 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 80490.8us
I20260204 08:59:46.098414 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.101965 18375 raft_consensus.cc:2393] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 2: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:46.034549 19722 consensus_queue.cc:1059] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
W20260204 08:59:46.137334 19748 log.cc:927] Time spent T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.114s user 0.000s sys 0.000s
W20260204 08:59:46.137617 19743 log.cc:927] Time spent T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.205s user 0.002s sys 0.000s
I20260204 08:59:46.132978 18445 raft_consensus.cc:2393] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:46.132407 19758 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.136673 19752 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.137022 19733 raft_consensus.cc:2749] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:46.136297 19753 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:46.112823 18414 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:46.096428 19100 raft_consensus.cc:1275] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:46.141830 19757 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
W20260204 08:59:46.146881 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 112990us
W20260204 08:59:46.151186 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 46164.7us
I20260204 08:59:46.103214 19750 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260204 08:59:46.172888 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 87433.1us
I20260204 08:59:46.152598 18520 raft_consensus.cc:1275] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:46.175805 18444 raft_consensus.cc:1275] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:46.180689 18377 raft_consensus.cc:3055] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:46.181080 18377 raft_consensus.cc:740] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:46.176847 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:46.177950 19681 raft_consensus.cc:2749] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:46.152732 19730 raft_consensus.cc:2749] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:46.185077 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:46.173991 19050 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:46.184480 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:46.185297 19761 consensus_queue.cc:1059] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260204 08:59:46.157923 19661 consensus_queue.cc:1048] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260204 08:59:46.185839 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.173561 19720 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.184085 19758 consensus_queue.cc:1048] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260204 08:59:46.173966 19633 consensus_meta.cc:287] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.686s user 0.009s sys 0.000s
I20260204 08:59:46.190129 18377 consensus_queue.cc:260] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:46.180830 19765 consensus_queue.cc:1059] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260204 08:59:46.193179 19749 log.cc:927] Time spent T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.157s user 0.001s sys 0.000s
I20260204 08:59:46.192939 19752 consensus_queue.cc:1048] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260204 08:59:46.196529 18340 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:46.200385 19761 consensus_queue.cc:1059] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:46.191933 19750 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:46.208017 19574 raft_consensus.cc:3055] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:46.298502 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:46.305322 19574 raft_consensus.cc:740] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:46.296869 19667 raft_consensus.cc:3055] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:46.306322 19667 raft_consensus.cc:740] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:46.296626 19766 raft_consensus.cc:3055] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:46.308084 19766 raft_consensus.cc:740] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
W20260204 08:59:46.308202 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 112023us
I20260204 08:59:46.249717 18377 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:46.305553 18525 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:46.206765 19423 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:46.310535 19722 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:46.307154 19667 consensus_queue.cc:260] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:46.311764 19667 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:46.312263 19423 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.280790 19099 raft_consensus.cc:1240] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:46.304472 19642 raft_consensus.cc:3055] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:46.313730 19642 raft_consensus.cc:740] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 08:59:46.247387 19721 consensus_meta.cc:287] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.764s user 0.005s sys 0.004s
I20260204 08:59:46.314347 19721 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:46.203583 19757 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:46.315559 19101 raft_consensus.cc:1240] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:46.226305 19768 consensus_queue.cc:1048] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260204 08:59:46.316179 19725 raft_consensus.cc:3055] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:46.316569 19725 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:46.314531 19642 consensus_queue.cc:260] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:46.190120 19747 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.286761 18414 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:46.243005 18449 raft_consensus.cc:1240] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:46.302342 18198 catalog_manager.cc:5654] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 4 to 5, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 5 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:46.280449 18372 raft_consensus.cc:1240] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
W20260204 08:59:46.211952 19729 consensus_meta.cc:287] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.640s user 0.008s sys 0.001s
I20260204 08:59:46.227510 18516 raft_consensus.cc:1275] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:46.319077 19108 raft_consensus.cc:1240] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
I20260204 08:59:46.284894 18448 raft_consensus.cc:1275] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260204 08:59:46.308571 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:46.317626 18375 raft_consensus.cc:1275] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260204 08:59:46.308838 19672 raft_consensus.cc:3055] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
W20260204 08:59:46.330555 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 43905.1us
I20260204 08:59:46.308543 19739 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:46.213088 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:46.331522 18198 catalog_manager.cc:5654] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } }
I20260204 08:59:46.208953 19633 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:46.279702 19740 consensus_meta.cc:287] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.581s user 0.010s sys 0.000s
I20260204 08:59:46.212020 18451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 570) took 1183 ms. Trace:
I20260204 08:59:46.260113 19750 raft_consensus.cc:697] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:46.197587 18446 raft_consensus.cc:1240] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:46.259837 19720 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:46.211038 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:46.209163 18445 raft_consensus.cc:1275] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:46.261221 19765 raft_consensus.cc:3055] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:46.303020 19698 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:46.273391 19690 raft_consensus.cc:3055] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:46.338950 18198 catalog_manager.cc:5654] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 1 to 2, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 2 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:46.244441 18368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 861) took 1003 ms. Trace:
I20260204 08:59:46.297973 18442 raft_consensus.cc:1240] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:46.349660 18451 rpcz_store.cc:276] 0204 08:59:45.014382 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:45.014510 (+ 128us) service_pool.cc:225] Handling call
0204 08:59:45.026327 (+ 11817us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:45.443229 (+416902us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:46.197942 (+754713us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400370854. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:46.198042 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":801213056}
W20260204 08:59:46.248749 19677 consensus_meta.cc:287] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.535s user 0.010s sys 0.000s
I20260204 08:59:46.209101 19671 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:46.352025 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 151017us
I20260204 08:59:46.353250 19646 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:46.359110 19642 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:46.355708 19685 consensus_queue.cc:1059] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:46.338907 19660 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260204 08:59:46.353624 18414 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:46.363478 18444 raft_consensus.cc:1240] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:46.362960 18447 raft_consensus.cc:2393] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:46.336612 19672 raft_consensus.cc:740] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:46.334491 19676 consensus_queue.cc:1059] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260204 08:59:46.334506 19768 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:46.384229 18488 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:46.374432 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 65552.6us
I20260204 08:59:46.366111 18198 catalog_manager.cc:5654] T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903 reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:46.354573 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:46.306201 19574 consensus_queue.cc:260] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:46.260439 19675 consensus_queue.cc:260] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:46.345333 19752 consensus_queue.cc:1059] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260204 08:59:46.367429 18371 raft_consensus.cc:1240] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:46.365123 19765 raft_consensus.cc:740] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:46.359673 19725 consensus_queue.cc:260] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:46.389103 18414 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:46.369290 19690 raft_consensus.cc:740] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:46.354094 19740 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:46.400151 18377 raft_consensus.cc:1275] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:46.400328 18340 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:46.391892 19629 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.402312 18491 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:46.401453 19750 consensus_queue.cc:237] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:46.367026 19720 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.379384 19646 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:46.337257 19729 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:46.308915 19766 consensus_queue.cc:260] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:46.422153 19751 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:46.405414 19734 consensus_queue.cc:1059] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260204 08:59:46.424005 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 50419.8us
I20260204 08:59:46.402114 19768 raft_consensus.cc:697] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:46.416150 19428 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:46.433647 18340 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:46.434928 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:46.435122 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:46.435346 19733 consensus_queue.cc:1048] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:46.435724 19690 consensus_queue.cc:260] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.431238 19050 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:46.368925 18368 rpcz_store.cc:276] 0204 08:59:45.241147 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:45.242136 (+ 989us) service_pool.cc:225] Handling call
0204 08:59:45.264342 (+ 22206us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:45.497886 (+233544us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:46.244150 (+746264us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400501ed4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:46.244350 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":465771776}
I20260204 08:59:46.435972 19746 consensus_queue.cc:1048] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:46.438189 19739 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:46.405968 19722 consensus_queue.cc:1059] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260204 08:59:46.458213 19108 raft_consensus.cc:1240] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:46.422753 19700 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:46.418154 19697 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.459431 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.423375 19721 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.425832 19747 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.480068 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:46.460974 19428 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.465485 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:46.466143 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.466418 19720 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:46.467065 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:46.458835 19660 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:46.428238 19651 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260204 08:59:46.436610 19631 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:46.474488 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:46.475009 19301 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:46.438805 19725 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:46.477454 18377 raft_consensus.cc:2393] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:46.425041 19757 consensus_queue.cc:1059] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260204 08:59:46.477826 19763 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:46.461611 19644 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 08:59:46.458746 19730 consensus_queue.cc:1048] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260204 08:59:46.427026 19756 consensus_queue.cc:1048] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260204 08:59:46.463754 19734 raft_consensus.cc:3055] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:46.478235 19676 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:46.456037 19761 consensus_queue.cc:1175] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c61e83e5fb7445e8bce7eca695977903" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260204 08:59:46.468290 19671 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.421607 19672 consensus_queue.cc:260] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:46.502166 19428 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:46.480545 19747 consensus_queue.cc:1059] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:46.468322 19653 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:46.509160 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:46.541003 18518 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
W20260204 08:59:46.541424 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 62821.3us
I20260204 08:59:46.545797 18414 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:46.501839 19690 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:46.549804 18340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:46.458557 19753 consensus_queue.cc:1048] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260204 08:59:46.550671 19428 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:46.556985 18518 raft_consensus.cc:1240] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:46.556977 19428 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:46.557634 19428 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:46.558409 19050 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:46.507977 19734 raft_consensus.cc:740] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:46.500488 19660 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:46.561977 18488 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:46.541805 19760 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:46.568207 19774 consensus_queue.cc:1059] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260204 08:59:46.504223 19773 consensus_queue.cc:1048] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260204 08:59:46.572191 18518 raft_consensus.cc:1240] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:46.501199 19629 consensus_queue.cc:1059] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260204 08:59:46.573338 19301 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:46.593212 19780 raft_consensus.cc:3055] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:46.593628 19780 raft_consensus.cc:740] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:46.574340 19428 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.575728 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:46.477885 19754 consensus_queue.cc:1048] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.119s
I20260204 08:59:46.505777 19631 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:46.573911 19720 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:46.601336 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.601923 18370 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:46.602138 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:46.579068 18516 raft_consensus.cc:1240] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
W20260204 08:59:46.580247 19769 log.cc:927] Time spent T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.123s user 0.001s sys 0.000s
I20260204 08:59:46.580849 18443 raft_consensus.cc:1240] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:46.478055 19765 consensus_queue.cc:260] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:46.587720 18523 raft_consensus.cc:1240] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:46.540104 19676 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.594547 19646 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:46.594996 19772 log.cc:927] Time spent T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20260204 08:59:46.569464 19649 raft_consensus.cc:3055] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:46.482461 19700 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:46.597266 19775 log.cc:927] Time spent T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.098s user 0.001s sys 0.000s
W20260204 08:59:46.816679 18343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:46.551338 19733 consensus_queue.cc:1048] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260204 08:59:46.551543 19653 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.612248 19428 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:46.614709 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:46.616113 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.550706 19768 consensus_queue.cc:237] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.600212 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:46.660243 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:46.609535 19755 consensus_meta.cc:287] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.507s user 0.009s sys 0.000s
I20260204 08:59:46.664671 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:46.966938 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:46.665378 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.600397 19740 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.632884 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:46.816046 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.629350 19751 consensus_queue.cc:1059] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.198s
I20260204 08:59:46.663349 19729 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.668133 19649 raft_consensus.cc:740] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:46.956578 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:46.965430 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:46.969890 19428 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:46.601058 19734 consensus_queue.cc:260] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.853232 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:46.959297 19732 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:46.956657 19637 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:46.955331 19739 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:46.982348 19428 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:46.984040 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 425661us
I20260204 08:59:46.974443 18520 raft_consensus.cc:1240] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:46.988072 18376 raft_consensus.cc:2393] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:46.967211 19773 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:46.995826 19773 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:46.993577 19050 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:46.974987 19755 raft_consensus.cc:2749] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260204 08:59:47.001199 19428 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.627912 19780 consensus_queue.cc:260] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:46.986529 19778 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.026489 19050 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:47.034621 19050 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:47.038589 19747 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 08:59:47.043429 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:46.986781 19637 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.027550 19750 raft_consensus.cc:2749] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:47.045504 19050 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:47.048086 19784 log.cc:927] Time spent T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.082s user 0.000s sys 0.001s
I20260204 08:59:47.049223 19676 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.030081 19734 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:47.045009 19698 consensus_meta.cc:287] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.678s user 0.012s sys 0.000s
I20260204 08:59:46.998908 19739 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:47.041637 18370 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:47.054103 19733 raft_consensus.cc:2749] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:47.012447 19649 consensus_queue.cc:260] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.057401 19760 consensus_queue.cc:1048] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:47.062225 19791 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.039819 19755 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:47.032469 19631 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:47.032176 19660 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:46.992555 19732 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.039135 19747 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.045162 19623 raft_consensus.cc:2749] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:47.082365 19747 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.083496 19672 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:47.094347 19741 raft_consensus.cc:3055] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:47.094530 19574 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:47.049652 19727 consensus_queue.cc:1048] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260204 08:59:47.108696 19675 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:47.103693 19633 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.099942 19741 raft_consensus.cc:740] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:47.096563 19631 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:47.118463 19301 consensus_queue.cc:1059] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:47.070361 19750 consensus_queue.cc:1048] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260204 08:59:47.120712 19301 raft_consensus.cc:3055] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:47.121031 19301 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:47.123128 19631 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.126438 19631 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.041348 19778 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:47.117182 19642 consensus_meta.cc:287] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.737s user 0.009s sys 0.000s
I20260204 08:59:47.110467 19760 consensus_queue.cc:1059] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260204 08:59:47.141383 19760 raft_consensus.cc:3055] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:47.141726 19760 raft_consensus.cc:740] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
W20260204 08:59:47.148844 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 188837us
I20260204 08:59:47.121460 19653 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.128921 19755 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:47.125043 19677 raft_consensus.cc:3055] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 08:59:47.155341 19105 raft_consensus.cc:1240] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:47.156540 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.121776 19633 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.160095 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.164608 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.165845 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.121754 19301 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.146466 19700 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.161113 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.163842 18444 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:47.175464 19050 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:47.154071 19677 raft_consensus.cc:740] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:47.174577 19721 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:47.171051 19752 consensus_queue.cc:1059] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260204 08:59:47.183595 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.183508 19750 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:47.171018 19653 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.184381 19750 raft_consensus.cc:697] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:47.184464 18449 raft_consensus.cc:2393] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 3: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:47.185818 18417 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:47.188634 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.184680 19653 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.184844 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.189857 19721 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.191412 19732 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.186934 19637 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.189728 19750 consensus_queue.cc:237] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:47.185554 19667 consensus_meta.cc:287] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.873s user 0.010s sys 0.001s
W20260204 08:59:47.206782 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.142457 19760 consensus_queue.cc:260] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.216638 18375 raft_consensus.cc:1275] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:47.158041 19755 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.185801 19773 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:47.228615 19760 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:47.228899 19747 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.229336 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.209746 19631 raft_consensus.cc:2749] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260204 08:59:47.223423 19690 consensus_meta.cc:287] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.661s user 0.009s sys 0.001s
I20260204 08:59:47.235452 18488 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:47.236946 19747 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.242030 19590 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:47.242796 19590 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:47.242870 19653 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.243345 19590 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:47.243945 19747 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.237329 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.217695 19739 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:47.242010 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.263839 19778 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.267535 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.249873 18443 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:47.271212 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.272356 18449 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:47.288892 18446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 889) took 1148 ms. Trace:
I20260204 08:59:47.289345 18446 rpcz_store.cc:276] 0204 08:59:46.140912 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.142305 (+ 1393us) service_pool.cc:225] Handling call
0204 08:59:46.164460 (+ 22155us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:46.359958 (+195498us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:47.288648 (+928690us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54005ef1d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:47.288835 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":41946496}
I20260204 08:59:47.291872 19671 raft_consensus.cc:3055] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:47.292279 19671 raft_consensus.cc:740] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:47.294672 18488 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:47.293951 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.296519 18448 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:47.226645 19677 consensus_queue.cc:260] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:47.305924 18414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.306761 19747 consensus_queue.cc:1059] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260204 08:59:47.308477 18414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.302990 18340 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:47.305337 18488 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:47.297549 19778 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:47.064123 19791 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:47.312969 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.320186 19747 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:47.297643 19631 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.327458 19747 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:47.327958 19747 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:47.327913 19631 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.327351 19671 consensus_queue.cc:260] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.339661 19107 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:47.342423 19757 raft_consensus.cc:3055] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:47.342897 19757 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:47.342816 19671 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
W20260204 08:59:47.329243 19725 consensus_meta.cc:287] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.818s user 0.007s sys 0.003s
I20260204 08:59:47.350719 19755 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:47.352886 18417 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:47.326900 19778 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:47.328720 19758 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:47.357395 18488 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:47.338449 19677 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
I20260204 08:59:47.364724 19685 raft_consensus.cc:3055] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:47.360044 19778 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:47.417620 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:47.417367 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:47.428736 18370 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:47.429098 19791 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:47.430100 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.430800 18442 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:47.432557 18340 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:47.433441 19791 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:47.433831 19791 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:47.343747 19757 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:47.434180 19791 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:47.435420 18488 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 08:59:47.435593 18343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.359377 19629 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:47.441231 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.361024 19697 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:47.360153 19758 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:47.368752 19685 raft_consensus.cc:740] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:47.365288 19633 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.450532 19642 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.452131 19642 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:47.452886 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.442375 19629 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:47.443578 19660 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260204 08:59:47.459530 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.450762 19697 raft_consensus.cc:697] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:47.467417 19697 consensus_queue.cc:237] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.449786 19758 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
W20260204 08:59:47.474653 18489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s user 0.010s sys 0.045s
I20260204 08:59:47.457245 19757 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:47.475173 18491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s user 0.014s sys 0.051s
W20260204 08:59:47.476956 18491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s user 0.015s sys 0.051s
I20260204 08:59:47.470777 19660 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:47.465236 19629 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
W20260204 08:59:47.477361 18489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s user 0.011s sys 0.046s
I20260204 08:59:47.481289 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.488714 18374 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:47.488910 19107 raft_consensus.cc:2393] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 3: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:47.482589 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:47.483738 19780 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:47.484581 19764 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:47.486162 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.502349 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.488417 19685 consensus_queue.cc:260] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.495371 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.503414 19685 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:47.490526 19631 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:47.504590 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.501446 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.502507 19100 raft_consensus.cc:2393] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 2: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:47.500211 18375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 673) took 1042 ms. Trace:
I20260204 08:59:47.505266 19108 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:47.506021 18375 rpcz_store.cc:276] 0204 08:59:46.457791 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.459107 (+ 1316us) service_pool.cc:225] Handling call
0204 08:59:46.459397 (+ 290us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:47.217019 (+757622us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:47.499974 (+282955us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400428454. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:47.500150 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1740735232}
I20260204 08:59:47.489223 19660 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 2
W20260204 08:59:47.509434 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.503439 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.510380 19754 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:47.508536 19099 raft_consensus.cc:1240] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 1. Current term is 2. Ops: []
W20260204 08:59:47.511592 18341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s user 0.016s sys 0.027s
W20260204 08:59:47.512679 18341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s user 0.016s sys 0.027s
W20260204 08:59:47.513171 18341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:47.513872 18524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s user 0.019s sys 0.022s
W20260204 08:59:47.514180 18524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s user 0.019s sys 0.022s
W20260204 08:59:47.518518 18415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s user 0.016s sys 0.019s
I20260204 08:59:47.510476 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:47.519860 18414 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 08:59:47.521307 18490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s user 0.014s sys 0.023s
W20260204 08:59:47.521603 18490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s user 0.014s sys 0.023s
I20260204 08:59:47.522325 19698 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.522807 19698 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.524683 19698 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:47.525116 19698 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.525576 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:47.503675 19796 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.526228 19740 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.526149 18375 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:47.526203 18491 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:47.528107 18488 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:47.528589 18491 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:47.529597 18372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.011s sys 0.023s
W20260204 08:59:47.530228 18372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s user 0.012s sys 0.024s
I20260204 08:59:47.525507 19698 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:47.529593 18415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s user 0.016s sys 0.019s
I20260204 08:59:47.532130 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.517504 19720 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 08:59:47.533335 18451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s user 0.012s sys 0.011s
W20260204 08:59:47.535266 18451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s user 0.012s sys 0.011s
I20260204 08:59:47.514564 19754 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.546145 19754 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:47.546715 19754 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:47.552320 18449 raft_consensus.cc:1240] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:47.548704 18448 raft_consensus.cc:1240] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:47.506134 19764 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:47.556998 19764 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:47.558589 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:47.529661 19779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.000s sys 0.027s
I20260204 08:59:47.560657 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:47.561334 18375 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:47.526770 19740 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.532768 19746 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.585628 19793 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.586243 19793 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.588294 19050 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:47.589582 19050 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:47.590233 19760 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:47.590646 19774 raft_consensus.cc:2749] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:47.548691 19651 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:47.588403 19793 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:47.596858 19050 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:47.568811 19779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s user 0.000s sys 0.028s
I20260204 08:59:47.559908 19745 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:47.547940 19637 consensus_queue.cc:1048] T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260204 08:59:47.551632 19720 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.663405 19698 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.663952 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.656067 19794 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.671236 18446 raft_consensus.cc:1240] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
W20260204 08:59:47.650138 19772 log.cc:927] Time spent T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
I20260204 08:59:47.592203 19106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 613) took 1073 ms. Trace:
I20260204 08:59:47.553687 19675 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:47.672184 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 75404us
I20260204 08:59:47.593575 19746 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.593905 19725 consensus_queue.cc:1059] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260204 08:59:47.654351 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.672598 19774 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 08:59:47.686679 19779 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.664546 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:47.648559 19651 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.669812 19739 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:47.680001 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.681480 19803 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:47.526569 19796 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.687417 19797 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:47.701462 18443 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:47.682662 19590 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:47.708313 19776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s user 0.008s sys 0.025s
W20260204 08:59:47.733321 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 205217us
I20260204 08:59:47.709599 19770 raft_consensus.cc:3055] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:47.731086 18343 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:47.701687 19675 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:47.705523 19755 consensus_queue.cc:1059] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260204 08:59:47.757507 19050 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:47.729743 18446 raft_consensus.cc:1275] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:47.694633 19745 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:47.734720 19776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s user 0.008s sys 0.026s
I20260204 08:59:47.765410 19765 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:47.706704 19794 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.781199 19740 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:47.782809 19740 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.783258 19740 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.727799 19739 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:47.760890 19764 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:47.739296 19798 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:47.733788 19803 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:47.800388 19802 log.cc:927] Time spent T b535c4ca953b4013861502cf99c90b2b P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
I20260204 08:59:47.766875 19725 raft_consensus.cc:3055] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:47.755007 19774 consensus_queue.cc:1059] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260204 08:59:47.801716 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 245493us
I20260204 08:59:47.739090 19734 consensus_queue.cc:1059] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260204 08:59:47.827965 19734 raft_consensus.cc:3055] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:47.828351 19734 raft_consensus.cc:740] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:47.829191 19734 consensus_queue.cc:260] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.830382 19734 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:47.755167 19770 raft_consensus.cc:740] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:47.701948 19106 rpcz_store.cc:276] 0204 08:59:46.510917 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.512478 (+ 1561us) service_pool.cc:225] Handling call
0204 08:59:46.552124 (+ 39646us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:46.598572 (+ 46448us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:46.600093 (+ 1521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:46.607063 (+ 6970us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:46.608684 (+ 1621us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:47.562532 (+953848us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5400005fd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:47.568427 (+ 5895us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:47.584607 (+ 16180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":64278272}
I20260204 08:59:47.831781 19767 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.723699 19779 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:47.842784 18414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.840271 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:47.802776 19766 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:47.809564 18520 raft_consensus.cc:1240] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260204 08:59:47.809445 18369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 214) took 1192 ms. Trace:
I20260204 08:59:47.807888 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.857149 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.857757 18443 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:47.858639 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.858752 18488 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:47.762614 19788 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:47.851272 19746 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:47.846122 19809 log.cc:927] Time spent T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260204 08:59:47.852607 19803 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:47.853094 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.811815 19725 raft_consensus.cc:740] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:47.839908 19104 raft_consensus.cc:1240] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:47.863057 19764 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.840220 19755 consensus_queue.cc:1048] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260204 08:59:47.863741 19806 log.cc:927] Time spent T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.105s user 0.000s sys 0.000s
I20260204 08:59:47.865005 19675 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:47.867273 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.826386 19671 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:47.826733 19798 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 08:59:47.867151 19747 consensus_meta.cc:287] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.539s user 0.008s sys 0.001s
I20260204 08:59:47.848080 18414 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:47.871672 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.946558 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:47.946888 18443 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:47.947827 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.915774 19750 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.878136 18445 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:47.948547 19750 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.949693 18375 raft_consensus.cc:1275] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:47.915172 19798 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:47.843111 19779 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:47.886516 19794 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.869451 19788 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:47.891369 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.917951 18488 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:47.875447 19795 log.cc:927] Time spent T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.221s user 0.000s sys 0.001s
I20260204 08:59:47.924995 19642 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.930197 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:47.914863 19677 consensus_meta.cc:287] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.549s user 0.009s sys 0.000s
W20260204 08:59:47.906813 18417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.915871 19675 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:47.981966 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 64097us
I20260204 08:59:47.951445 19633 raft_consensus.cc:2749] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260204 08:59:47.932737 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 404483us
W20260204 08:59:47.933167 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:47.934964 19681 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:47.937654 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:47.941251 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.942543 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.942847 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.951098 19750 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:48.018421 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:47.832276 19767 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.877468 19685 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:47.948406 19741 consensus_queue.cc:260] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:47.983981 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.025904 18374 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:48.025686 19685 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.026003 19741 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:47.974934 19760 consensus_queue.cc:1048] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260204 08:59:47.984788 19590 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.959421 19816 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:47.952720 19747 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:47.986135 19102 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:47.981967 19740 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:47.981501 19676 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:48.026767 19660 consensus_meta.cc:287] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.513s user 0.006s sys 0.002s
I20260204 08:59:47.993865 19651 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:47.988286 19814 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:47.988518 19721 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:47.990324 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.856113 18369 rpcz_store.cc:276] 0204 08:59:46.617134 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.627097 (+ 9963us) service_pool.cc:225] Handling call
0204 08:59:47.713573 (+1086476us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b5800035798. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb530412e 000000000035a3c9 00007fcebd336560 00007fcebd3fedd4 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:47.726701 (+ 13128us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:47.757164 (+ 30463us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:47.760618 (+ 3454us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:47.762452 (+ 1834us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:47.766767 (+ 4315us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:47.784277 (+ 17510us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:47.808109 (+ 23832us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":145479424}
I20260204 08:59:47.993924 18488 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 08:59:47.999936 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 55669.1us
I20260204 08:59:47.962769 19788 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:47.932060 19790 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.056905 19790 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:47.974472 19799 log.cc:927] Time spent T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.150s user 0.001s sys 0.000s
I20260204 08:59:48.056226 18447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 588) took 1670 ms. Trace:
I20260204 08:59:47.967401 19779 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:48.060715 19779 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.061190 19779 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:48.063966 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 558) took 1461 ms. Trace:
I20260204 08:59:48.064410 18524 rpcz_store.cc:276] 0204 08:59:46.603030 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.603685 (+ 655us) service_pool.cc:225] Handling call
0204 08:59:46.632311 (+ 28626us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:46.956586 (+324275us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:46.956615 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:46.962920 (+ 6305us) log.cc:844] Serialized 26 byte log entry
0204 08:59:47.517296 (+554376us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:47.517334 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:47.517408 (+ 74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:48.063715 (+546307us) raft_consensus.cc:1685] finished
0204 08:59:48.063739 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:48.063884 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":322636,"raft.queue_time_us":324780,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":14663,"thread_start_us":532379,"threads_started":1,"wal-append.queue_time_us":677635}
I20260204 08:59:48.065968 19788 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.066258 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.066993 18524 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 1.
I20260204 08:59:48.018179 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:47.734318 19797 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:47.959478 19739 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:48.023692 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 63105.5us
I20260204 08:59:48.068946 18343 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:48.069258 19790 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.070307 19797 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:48.024554 19767 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.006887 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.025087 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.039716 18374 raft_consensus.cc:1275] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:47.952069 19671 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.039776 18442 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:48.044149 18525 raft_consensus.cc:1240] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260204 08:59:47.987843 19099 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
I20260204 08:59:48.013787 19677 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 08:59:48.050340 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:48.051090 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.023058 19100 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
W20260204 08:59:48.043435 19102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46718 (request call id 589) took 1377 ms (client timeout 1648 ms). Trace:
I20260204 08:59:48.067950 18450 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:48.021063 19794 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:47.889519 19764 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:48.072209 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 78370.5us
I20260204 08:59:48.072520 19590 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:48.072934 19700 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:48.111385 19700 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.042487 19816 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.011521 19675 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.076571 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:47.975682 19725 consensus_queue.cc:260] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.119199 18488 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:48.044797 18516 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:48.119789 19725 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:48.109493 19796 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.103251 19767 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:48.072962 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.099562 19099 raft_consensus.cc:606] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:48.083889 19747 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.099987 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.112175 19750 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:48.071794 19740 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:48.070945 19642 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:48.109853 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.104324 19794 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.110324 18343 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 08:59:48.175124 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 64875.9us
I20260204 08:59:48.100080 19574 consensus_queue.cc:1048] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260204 08:59:48.073516 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.210548 19105 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:48.112665 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.060488 18447 rpcz_store.cc:276] 0204 08:59:46.385867 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.386030 (+ 163us) service_pool.cc:225] Handling call
0204 08:59:46.406365 (+ 20335us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:46.416218 (+ 9853us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:46.416246 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:46.423115 (+ 6869us) log.cc:844] Serialized 26 byte log entry
0204 08:59:47.039288 (+616173us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b1800126c40. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fcebe19dc91 00007fcebe1aa671 00007fceb5323c67 00007fcebe114709 00007fceb534057b 00007fceb533e81f 00007fceb5340ae2 00007fceb7f885ab 00007fceb7f8e0c3 00007fceb7f8e471 00007fceb83aa73f
0204 08:59:47.424329 (+385041us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:47.680441 (+256112us) log.cc:844] Serialized 14 byte log entry
0204 08:59:47.685017 (+ 4576us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:47.685084 (+ 67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:48.055946 (+370862us) raft_consensus.cc:1685] finished
0204 08:59:48.056044 (+ 98us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:48.056174 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27145,"prepare.queue_time_us":307330,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":1592,"raft.queue_time_us":60797,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":22057,"spinlock_wait_cycles":3710208,"thread_start_us":614943,"threads_started":2,"wal-append.queue_time_us":1102545}
I20260204 08:59:48.115008 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.053473 19660 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:48.117066 19754 consensus_meta.cc:287] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.570s user 0.004s sys 0.004s
W20260204 08:59:48.168774 19791 consensus_meta.cc:287] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.734s user 0.011s sys 0.001s
I20260204 08:59:48.080463 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.072544 19106 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:48.052110 19676 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.089241 19109 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:48.071594 19814 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.108922 19590 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:48.140460 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:48.174651 19675 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:48.174021 19798 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.144174 19099 raft_consensus.cc:614] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 08:59:48.146859 18369 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:48.146948 18373 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
W20260204 08:59:48.088294 19102 rpcz_store.cc:269] 0204 08:59:46.666166 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.668631 (+ 2465us) service_pool.cc:225] Handling call
0204 08:59:47.507864 (+839233us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:48.042847 (+534983us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":61926784}
I20260204 08:59:48.147615 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.149224 19700 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.144711 18450 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
W20260204 08:59:48.154910 19820 log.cc:927] Time spent T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.100s user 0.000s sys 0.000s
I20260204 08:59:48.156600 19761 raft_consensus.cc:3055] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:48.096474 19050 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:48.158010 18445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47922 (request call id 589) took 1693 ms (client timeout 1508 ms). Trace:
I20260204 08:59:48.123513 19746 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.230484 19104 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:48.121994 19816 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
W20260204 08:59:48.164222 19629 consensus_meta.cc:287] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.651s user 0.009s sys 0.000s
I20260204 08:59:48.145907 19796 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.117465 19720 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.254345 19788 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:48.137322 19745 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:48.214993 19758 consensus_meta.cc:287] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.738s user 0.001s sys 0.009s
W20260204 08:59:48.230949 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:48.021417 19681 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.216389 19628 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:48.145462 19767 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.299392 19628 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.299916 19628 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:48.300700 19767 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.218883 19677 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:48.219501 19642 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:48.223153 19778 consensus_meta.cc:287] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.787s user 0.006s sys 0.004s
I20260204 08:59:48.257737 19761 raft_consensus.cc:740] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:48.301589 19778 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.302150 19761 consensus_queue.cc:260] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.303184 19761 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:48.303447 19778 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.239534 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.241936 19107 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:48.225153 19754 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:48.168454 19750 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.237293 19590 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:48.226259 18517 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:48.177688 19740 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:48.258052 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 161674us
I20260204 08:59:48.316434 19050 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:48.172807 19747 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.310321 19642 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.325330 19767 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260204 08:59:48.259606 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 411589us
I20260204 08:59:48.226708 19791 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.326589 19642 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.326910 18414 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:48.266359 18450 raft_consensus.cc:1240] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:48.327607 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.328418 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.301309 19677 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.329032 19677 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:48.329564 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:48.330361 19780 raft_consensus.cc:2749] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:48.250434 19685 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.279356 19796 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.333153 19796 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.257534 18516 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:48.334177 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.334744 18516 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:48.284255 18377 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
W20260204 08:59:48.284572 19800 log.cc:927] Time spent T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: Append to log took a long time: real 0.132s user 0.000s sys 0.000s
I20260204 08:59:48.260398 19700 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.341109 19700 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.337019 19644 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.341825 19740 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.342279 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.343631 19750 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.344002 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:48.345036 19700 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.258251 19698 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:48.289332 18442 raft_consensus.cc:1275] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:48.290396 19819 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:48.333333 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:48.146212 19739 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:48.350741 19725 consensus_queue.cc:1059] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:48.299511 19824 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.269114 19629 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.294147 19671 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.296808 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.307271 19764 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.262676 19760 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:48.304352 18524 raft_consensus.cc:2393] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
W20260204 08:59:48.298826 19757 consensus_meta.cc:287] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.821s user 0.006s sys 0.004s
I20260204 08:59:48.323593 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.323674 18369 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:48.324607 19747 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.327212 19791 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:48.257937 18445 rpcz_store.cc:269] 0204 08:59:46.464703 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.465899 (+ 1196us) service_pool.cc:225] Handling call
0204 08:59:47.482433 (+1016534us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:48.157802 (+675369us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540016ec54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:48.157922 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":279936512}
I20260204 08:59:48.380205 18522 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:48.380895 18445 raft_consensus.cc:1240] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:48.381603 19747 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.382839 19629 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.384485 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.325721 19301 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:48.301313 19681 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:48.335672 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.325733 19767 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.265084 19746 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.348771 18414 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:48.349747 18450 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:48.350384 19819 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.351516 19824 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:48.354138 19101 consensus_meta.cc:287] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.991s user 0.009s sys 0.000s
I20260204 08:59:48.356966 19816 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.328742 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.304340 19758 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.374392 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.374884 19671 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:48.376004 19660 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:48.375896 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:48.408589 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:48.378355 19779 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.404106 18443 raft_consensus.cc:2393] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:48.370622 19788 consensus_queue.cc:1048] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260204 08:59:48.422358 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.358045 19644 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.352352 19633 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:48.357197 19590 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:48.397326 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 48625.5us
I20260204 08:59:48.398320 19050 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:48.351190 19739 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.406131 18524 raft_consensus.cc:2368] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:48.367921 19760 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.394939 19794 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.397850 19767 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:48.476903 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:48.404235 19681 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:48.467582 18523 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:48.385489 19628 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.483393 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.485685 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.486357 18524 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
W20260204 08:59:48.478013 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 79774.4us
I20260204 08:59:48.472045 18414 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:48.476929 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.481722 18520 raft_consensus.cc:2368] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:48.479921 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.405228 19676 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.480651 18376 raft_consensus.cc:1240] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:48.420775 19791 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.496865 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.499212 18414 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:48.478731 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.419668 19798 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.406329 19101 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:48.408802 18517 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
W20260204 08:59:48.502241 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 383116us
I20260204 08:59:48.502417 19108 raft_consensus.cc:2393] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:48.478389 19760 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:48.481036 19681 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.480446 19741 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:48.419075 19671 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.485968 18371 raft_consensus.cc:1240] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:48.496513 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.508594 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.520650 18518 raft_consensus.cc:2368] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5.
I20260204 08:59:48.486938 19725 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:48.494246 19757 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:48.510519 19301 consensus_queue.cc:1059] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260204 08:59:48.521944 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:48.511761 18450 raft_consensus.cc:1240] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:48.480952 19633 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.507301 18375 raft_consensus.cc:2393] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:48.502152 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:48.497551 19814 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.516446 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.524127 19301 consensus_queue.cc:1059] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:48.540184 18524 raft_consensus.cc:1240] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:48.524956 19105 raft_consensus.cc:2393] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 2: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:48.518333 19681 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:48.509392 18442 raft_consensus.cc:1240] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260204 08:59:48.545360 18372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 883) took 1880 ms. Trace:
I20260204 08:59:48.548219 18372 rpcz_store.cc:276] 0204 08:59:46.664953 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.972526 (+307573us) service_pool.cc:225] Handling call
0204 08:59:46.972807 (+ 281us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 08:59:47.530639 (+557832us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:47.530667 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 08:59:47.992097 (+461430us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b2c000471f8. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb6ced9b1 00007fceb6cfcfe2 00007fceb842a851 00007fceb83ef0ba 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22
0204 08:59:47.992622 (+ 525us) log.cc:844] Serialized 52 byte log entry
0204 08:59:48.433828 (+441206us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:48.433867 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.433940 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:48.534323 (+100383us) raft_consensus.cc:1685] finished
0204 08:59:48.534350 (+ 27us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:48.545305 (+ 10955us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":77812,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13513,"spinlock_wait_cycles":7435008,"thread_start_us":998287,"threads_started":2,"wal-append.queue_time_us":538816}
I20260204 08:59:48.550515 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:48.504777 18417 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.525s user 0.003s sys 0.013s
I20260204 08:59:48.515681 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:48.551277 18417 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.572s user 0.003s sys 0.013s
I20260204 08:59:48.513105 18414 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:48.530350 19697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.009s user 0.039s sys 0.027s
I20260204 08:59:48.531595 18369 raft_consensus.cc:606] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:48.532333 18491 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:48.504504 19830 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:48.518136 19629 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260204 08:59:48.508697 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 453381us
W20260204 08:59:48.557979 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 44951.7us
I20260204 08:59:48.537835 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.559237 18375 raft_consensus.cc:2368] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3.
I20260204 08:59:48.560168 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.561380 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.506516 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:48.551570 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 572014us
I20260204 08:59:48.527415 19574 raft_consensus.cc:3055] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:48.556830 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:48.562865 18372 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:48.527630 19676 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:48.558633 18340 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:48.564304 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:48.556911 19099 raft_consensus.cc:2393] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 2: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
W20260204 08:59:48.554430 19697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.035s user 0.039s sys 0.027s
I20260204 08:59:48.570405 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:48.516129 19791 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.524737 19741 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.572939 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:48.576210 18340 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:48.529649 19757 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.564955 19631 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:48.579077 18414 leader_election.cc:400] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:48.616003 18414 leader_election.cc:403] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:48.579574 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 245) took 1061 ms. Trace:
I20260204 08:59:48.616912 18525 rpcz_store.cc:276] 0204 08:59:47.517963 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:47.518209 (+ 246us) service_pool.cc:225] Handling call
0204 08:59:47.532166 (+ 13957us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:48.088570 (+556404us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.579360 (+490790us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54000dd254. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:48.579523 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1176893184}
I20260204 08:59:48.557487 18369 raft_consensus.cc:614] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 08:59:48.609627 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.622081 18376 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:48.580726 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.566172 19721 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.637238 18488 leader_election.cc:400] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3.
I20260204 08:59:48.613425 18340 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:48.614938 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.559768 19629 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.565205 19574 raft_consensus.cc:740] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:48.624676 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.665647 18375 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:48.637070 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.637542 18488 leader_election.cc:403] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:48.582353 19756 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260204 08:59:48.638358 18377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34974 (request call id 208) took 2009 ms (client timeout 2010 ms). Trace:
W20260204 08:59:48.685091 18377 rpcz_store.cc:269] 0204 08:59:46.613559 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.613672 (+ 113us) service_pool.cc:225] Handling call
0204 08:59:48.622768 (+2009096us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001fa254. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:48.622854 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2984286592}
I20260204 08:59:48.686193 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:48.638855 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:48.661085 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 128845us
W20260204 08:59:48.688023 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 64270.5us
W20260204 08:59:48.639271 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 60338.7us
I20260204 08:59:48.688922 18414 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:48.577412 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:48.665967 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 52732.3us
I20260204 08:59:48.691993 19738 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.692516 19738 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.693605 19675 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.694106 19675 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.694495 19738 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.695778 19721 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:48.696522 18376 raft_consensus.cc:2393] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:48.696957 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.697631 19105 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:48.689093 18488 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:48.688349 18491 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:48.665529 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:48.700187 18447 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:48.666137 19109 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:48.577430 18516 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:48.616573 19746 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.701915 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.615496 19659 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:48.624723 19631 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.687333 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:48.705951 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.707355 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:48.637837 19814 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.572882 19676 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.665313 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.705386 18343 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:48.667903 19629 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:48.779615 18450 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:48.689553 19756 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.568738 19770 consensus_queue.cc:260] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.706794 19628 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:48.782979 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 77690.4us
I20260204 08:59:48.640100 19819 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:48.664204 19590 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.688020 19649 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:48.689388 19781 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 5
I20260204 08:59:48.709561 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.774883 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.791097 18372 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:48.781612 18491 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:48.688201 19765 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:48.703106 19788 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:48.707858 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 179290us
W20260204 08:59:48.841766 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:48.841810 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:48.843272 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 61729.3us
I20260204 08:59:48.695984 19675 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:48.769654 19659 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.707269 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.703751 19660 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 1 FOLLOWER]: Advancing to term 3
I20260204 08:59:48.698393 19697 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260204 08:59:48.846869 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:48.707192 19824 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.706805 19798 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:48.688930 19758 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.781001 19631 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:48.936664 19642 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:48.937212 19642 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:48.939134 19642 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:48.939343 19839 log.cc:927] Time spent T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.108s user 0.000s sys 0.000s
I20260204 08:59:48.848058 19099 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
W20260204 08:59:48.939788 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:48.927567 19659 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:48.940611 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.941291 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 619) took 1181 ms. Trace:
I20260204 08:59:48.702498 19739 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:48.941646 18523 rpcz_store.cc:276] 0204 08:59:47.759628 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:48.510138 (+750510us) service_pool.cc:225] Handling call
0204 08:59:48.510394 (+ 256us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:48.542222 (+ 31828us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:48.542251 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:48.542297 (+ 46us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:48.542327 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.941078 (+398751us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54000dc854. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:48.941130 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:48.941241 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":72804224}
I20260204 08:59:48.942878 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:48.943125 19101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46718 (request call id 585) took 2480 ms (client timeout 1563 ms). Trace:
I20260204 08:59:48.827507 18377 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
W20260204 08:59:48.943539 19101 rpcz_store.cc:269] 0204 08:59:46.462860 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.463471 (+ 611us) service_pool.cc:225] Handling call
0204 08:59:48.942929 (+2479458us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54000096d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:48.943036 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1980103424}
I20260204 08:59:48.770097 19780 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:48.770021 19836 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:48.944741 19836 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.945122 19836 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:48.945871 18443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47928 (request call id 904) took 1058 ms. Trace:
I20260204 08:59:48.946264 18443 rpcz_store.cc:276] 0204 08:59:47.887550 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:47.947565 (+ 60015us) service_pool.cc:225] Handling call
0204 08:59:48.945680 (+998115us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54006df1d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:48.945816 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":968912256}
I20260204 08:59:48.947264 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:48.832295 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.950052 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:48.951022 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.707953 19779 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.953547 19301 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.953738 18451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 590) took 2390 ms. Trace:
W20260204 08:59:48.954355 19761 consensus_meta.cc:287] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.651s user 0.007s sys 0.001s
I20260204 08:59:48.954843 19761 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.955555 19824 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.789363 19783 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:48.956048 19824 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.956406 19783 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:48.956795 19783 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:48.835105 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.837198 18488 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 08:59:48.958510 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 121387us
I20260204 08:59:48.951529 18444 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:48.958617 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.960142 18488 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:48.961259 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.961489 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:48.961673 18488 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:48.955302 18414 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:48.962546 18444 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:48.961825 18377 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:48.965155 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.965803 18377 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:48.966971 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.802635 19756 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:48.835184 19827 log.cc:927] Time spent T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.338s user 0.001s sys 0.000s
I20260204 08:59:48.844561 19671 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.847561 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:48.783918 19814 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.846927 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:48.833669 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:48.845880 19721 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:48.926714 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:48.992949 19107 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:48.954957 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:48.848263 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:48.932798 19798 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.979627 19740 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election won for term 5
W20260204 08:59:48.936007 19840 log.cc:927] Time spent T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.110s user 0.000s sys 0.000s
I20260204 08:59:48.923069 19697 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.689150 19816 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:48.922698 19770 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:48.948204 18373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45710 (request call id 890) took 1203 ms. Trace:
I20260204 08:59:48.941247 18375 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:48.947264 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:48.840153 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:48.940524 18522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 563) took 1391 ms (client timeout 1529 ms). Trace:
I20260204 08:59:48.959096 19301 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:48.828181 19725 raft_consensus.cc:697] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:48.976887 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:48.978566 18340 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:48.820739 19574 consensus_queue.cc:260] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.892760 19747 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:49.027321 19747 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:49.028043 19845 log.cc:927] Time spent T 1b2ad7461fbe43dea33bdbb755e246c9 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.194s user 0.000s sys 0.000s
I20260204 08:59:48.894173 19590 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:48.980592 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.030874 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:48.954093 18451 rpcz_store.cc:276] 0204 08:59:46.562962 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.571270 (+ 8308us) service_pool.cc:225] Handling call
0204 08:59:46.588830 (+ 17560us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:46.664319 (+ 75489us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:46.664348 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:46.664826 (+ 478us) log.cc:844] Serialized 26 byte log entry
0204 08:59:47.535925 (+871099us) raft_consensus.cc:1645] Marking committed up to 1
0204 08:59:47.535967 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.157211 (+621244us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b54005eecd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:48.157262 (+ 51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:48.948909 (+791647us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b240038f378. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5195ad4 00007fceb5193bdb 00007fceb5222ad9 00007fceb5222765 00007fceb5221cc0 00007fceb7fb6828 00007fceb7fb6f88 00007fceb7f8e738 00007fceb7f89b0a 00007fceb7f88f56
0204 08:59:48.953546 (+ 4637us) raft_consensus.cc:1685] finished
0204 08:59:48.953567 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:48.953688 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36557,"raft.queue_time_us":36673,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":68039,"spinlock_wait_cycles":106212480,"thread_start_us":569308,"threads_started":1,"wal-append.queue_time_us":888224}
W20260204 08:59:49.031831 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:48.845088 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:48.936628 19841 log.cc:927] Time spent T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.239s user 0.000s sys 0.000s
I20260204 08:59:48.878182 19633 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:48.875738 19829 log.cc:927] Time spent T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.359s user 0.000s sys 0.001s
I20260204 08:59:48.957878 19824 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:48.957934 19822 log.cc:927] Time spent T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.420s user 0.000s sys 0.001s
I20260204 08:59:48.845594 19765 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:48.932035 19750 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.999065 18444 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 08:59:49.021116 19740 raft_consensus.cc:697] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:48.955265 19761 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:48.892445 19700 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:48.955408 19631 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.004170 18417 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:49.051607 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 47535.4us
I20260204 08:59:48.935882 19675 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:48.977084 19698 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:48.979203 19794 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:48.977684 19739 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:49.002429 18370 raft_consensus.cc:2393] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:48.990448 19819 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:48.848498 19788 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.002166 19671 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 08:59:49.005250 19798 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.001459 19741 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.000679 19791 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.018620 19105 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:49.017792 18450 raft_consensus.cc:2393] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:49.006304 19780 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:49.007019 19757 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.020689 19301 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.025357 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.046356 19676 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.067696 18375 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:49.068625 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:49.017778 18522 rpcz_store.cc:269] 0204 08:59:47.549167 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:47.549287 (+ 120us) service_pool.cc:225] Handling call
0204 08:59:48.296661 (+747374us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:48.940366 (+643705us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54007035d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:48.940477 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":49188480}
I20260204 08:59:49.017616 18524 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
W20260204 08:59:49.025444 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 46964.1us
I20260204 08:59:49.008081 19721 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:49.011510 19697 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.034179 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:49.019232 18517 raft_consensus.cc:2368] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5.
W20260204 08:59:49.034658 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 191304us
I20260204 08:59:49.037281 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.078738 18445 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.041990 19107 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:49.028528 19642 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:49.034695 19590 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.053428 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 618) took 1757 ms. Trace:
I20260204 08:59:49.054023 18417 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.055137 19794 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:49.033833 19758 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:49.091018 19758 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.067348 19836 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.092643 19644 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.092835 19758 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.065809 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.093649 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.094368 18445 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:49.095223 18523 raft_consensus.cc:2393] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
W20260204 08:59:49.060883 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:49.048089 19765 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
W20260204 08:59:49.063508 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 101902us
I20260204 08:59:49.056815 19698 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:49.055327 19766 consensus_meta.cc:287] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 1.194s user 0.008s sys 0.002s
I20260204 08:59:49.044468 18368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 686) took 1200 ms. Trace:
I20260204 08:59:49.059001 19819 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.071162 18447 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:49.060693 19739 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.084196 19856 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:49.054998 19779 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:49.081454 18343 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:49.095903 19794 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.083913 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.085211 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.016866 18373 rpcz_store.cc:276] 0204 08:59:47.744443 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:47.961220 (+216777us) service_pool.cc:225] Handling call
0204 08:59:48.948053 (+986833us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b5400427f54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:48.948151 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":134888704}
I20260204 08:59:49.086378 18449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 289) took 1512 ms. Trace:
I20260204 08:59:49.080060 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.090245 19633 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:49.119563 19633 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.080536 19721 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.121421 19633 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:49.090596 19844 log.cc:927] Time spent T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.088s user 0.000s sys 0.001s
I20260204 08:59:49.122011 19721 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.077296 19780 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.123085 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.079738 19725 consensus_queue.cc:237] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:49.124171 19677 consensus_meta.cc:287] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.795s user 0.007s sys 0.003s
I20260204 08:59:49.110195 19755 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:49.124536 19677 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.124970 19783 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.126420 19677 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.126755 19783 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.126957 18375 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:49.118847 18449 rpcz_store.cc:276] 0204 08:59:47.573510 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:47.573751 (+ 241us) service_pool.cc:225] Handling call
0204 08:59:47.574073 (+ 322us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:47.890748 (+316675us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:47.891531 (+ 783us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:47.950889 (+ 59358us) log.cc:844] Serialized 26 byte log entry
0204 08:59:48.258716 (+307827us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:48.258749 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.258810 (+ 61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:49.086210 (+827400us) raft_consensus.cc:1685] finished
0204 08:59:49.086225 (+ 15us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:49.086331 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":85630,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":1970,"thread_start_us":623775,"threads_started":2,"wal-append.queue_time_us":526201}
I20260204 08:59:49.128417 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.129132 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.129721 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.130797 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:49.133366 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 53379.2us
I20260204 08:59:49.135813 19851 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:49.136411 19851 consensus_queue.cc:1059] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:49.130131 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.101091 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.103912 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.139191 18524 raft_consensus.cc:2393] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:49.053588 19750 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.055626 19700 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.087867 18521 rpcz_store.cc:276] 0204 08:59:47.295663 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:47.295935 (+ 272us) service_pool.cc:225] Handling call
0204 08:59:47.308075 (+ 12140us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:47.309236 (+ 1161us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:47.309267 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:47.319393 (+ 10126us) log.cc:844] Serialized 26 byte log entry
0204 08:59:47.921862 (+602469us) spinlock_profiling.cc:243] Waited 980 us on lock 0x7b18003d31e0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fcebe19dc91 00007fcebe1aa671 00007fceb5323c67 00007fcebe114709 00007fceb534057b 00007fceb533e81f 00007fceb5340ae2 00007fceb7f885ab 00007fceb7f8e0c3 00007fceb7f8e471 00007fceb83aa73f
0204 08:59:48.231893 (+310031us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:48.255494 (+ 23601us) log.cc:844] Serialized 14 byte log entry
0204 08:59:48.255719 (+ 225us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.255791 (+ 72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:49.048620 (+792829us) raft_consensus.cc:1685] finished
0204 08:59:49.053212 (+ 4592us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:49.053359 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2576,"prepare.queue_time_us":21890,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":41759,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":2938,"spinlock_wait_cycles":2254208,"thread_start_us":309853,"threads_started":1,"wal-append.queue_time_us":1086092}
I20260204 08:59:49.106573 18488 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.078598 18519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 246) took 1554 ms. Trace:
I20260204 08:59:49.072350 19671 raft_consensus.cc:697] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:49.143072 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.077857 19850 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:49.145905 19791 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:49.145975 19850 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.146488 19791 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:49.146876 19791 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.148180 19850 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.149310 19761 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.150645 19109 raft_consensus.cc:2393] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 3: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:49.075099 18446 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:49.057586 19675 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.093413 19836 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.112879 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.119195 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.098937 19649 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:49.076860 18340 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:49.157029 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 80244us
I20260204 08:59:49.157609 18340 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.115490 19107 raft_consensus.cc:2376] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5. Re-sending same reply.
I20260204 08:59:49.116586 18414 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.123793 19780 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.165853 18442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 299) took 1143 ms. Trace:
I20260204 08:59:49.166404 19851 raft_consensus.cc:3055] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:49.166775 19851 raft_consensus.cc:740] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:49.167503 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.167559 19851 consensus_queue.cc:260] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.168738 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.119000 19698 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.098465 18417 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.131413 19856 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.112298 19747 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.138671 18450 raft_consensus.cc:2393] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:49.104357 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:49.109978 19102 raft_consensus.cc:1275] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:49.168994 19851 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.180989 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.111220 19819 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.176162 19824 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:49.153019 19646 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:49.143327 18377 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:49.188432 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.188673 19646 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.189565 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.189983 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.190652 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.146006 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:49.096062 19590 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.196064 18376 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:49.159582 19779 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.159740 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.159919 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.202555 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.160120 19649 raft_consensus.cc:697] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:49.118342 19814 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.207882 19788 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.160593 18525 raft_consensus.cc:1240] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:49.124874 19755 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.163267 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.213380 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.108992 19740 consensus_queue.cc:237] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.164875 19660 raft_consensus.cc:2749] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3.
I20260204 08:59:49.186698 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.220675 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.177860 19781 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:49.137434 19756 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.221777 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.222302 18525 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:49.222594 19756 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.170682 19700 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.154179 19798 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.180471 19765 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.182080 19739 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.224463 19798 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.192870 19856 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.191411 18445 raft_consensus.cc:2376] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4. Re-sending same reply.
W20260204 08:59:49.142489 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 61142.1us
I20260204 08:59:49.190989 19646 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.166241 18442 rpcz_store.cc:276] 0204 08:59:48.022612 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:48.346874 (+324262us) service_pool.cc:225] Handling call
0204 08:59:48.347197 (+ 323us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:48.557201 (+210004us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:49.165550 (+608349us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400576f54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:49.165798 (+ 248us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":319114496}
I20260204 08:59:49.139628 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.145252 19050 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.209926 19750 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:49.235087 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 89876.1us
I20260204 08:59:49.196869 18340 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:49.236703 18340 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:49.239110 18340 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.186517 19629 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.198928 18414 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:49.242892 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 44048us
I20260204 08:59:49.243840 18414 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:49.155232 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 48723.5us
I20260204 08:59:49.244184 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.244803 18488 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.245819 18488 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.245685 18340 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:49.202966 18521 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:49.181062 19631 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.206738 19102 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.159600 19671 consensus_queue.cc:237] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.200778 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.209767 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:49.172772 19767 consensus_meta.cc:287] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.691s user 0.008s sys 0.000s
W20260204 08:59:49.174214 19681 consensus_meta.cc:287] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.618s user 0.008s sys 0.000s
I20260204 08:59:49.106647 18368 rpcz_store.cc:276] 0204 08:59:47.842402 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:48.161113 (+318711us) service_pool.cc:225] Handling call
0204 08:59:48.161513 (+ 400us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:48.161856 (+ 343us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:48.161887 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:48.162387 (+ 500us) log.cc:844] Serialized 26 byte log entry
0204 08:59:48.531433 (+369046us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:48.531482 (+ 49us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.532754 (+ 1272us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:48.938835 (+406081us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 08:59:49.016688 (+ 77853us) raft_consensus.cc:1685] finished
0204 08:59:49.019588 (+ 2900us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:49.042929 (+ 23341us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":5465,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":8972672,"thread_start_us":358632,"threads_started":1,"wal-append.queue_time_us":526401}
I20260204 08:59:49.218410 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
W20260204 08:59:49.170794 19760 consensus_meta.cc:287] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.648s user 0.003s sys 0.006s
I20260204 08:59:49.276176 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:49.223100 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.276654 18523 raft_consensus.cc:1240] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:49.277094 18521 raft_consensus.cc:1240] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:49.193801 19780 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.169626 18373 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.230993 18343 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 08:59:49.194067 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 95697.1us
W20260204 08:59:49.278584 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 47665.4us
I20260204 08:59:49.282433 18417 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.203570 19850 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.233655 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.282694 19819 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.283167 19107 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:49.250355 19660 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:49.283882 18449 raft_consensus.cc:2393] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:49.284091 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.284659 19107 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.175817 19675 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.190742 19106 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:49.285876 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.246924 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:49.217447 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.193763 19791 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.248955 19050 leader_election.cc:400] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5.
I20260204 08:59:49.249083 18488 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.249603 19798 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:49.269343 18524 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:49.268735 19109 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:49.250030 19735 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:49.247854 19856 raft_consensus.cc:2749] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.275985 19760 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.226048 18370 raft_consensus.cc:1240] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260204 08:59:49.353578 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 104564us
I20260204 08:59:49.355118 18445 raft_consensus.cc:2393] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:49.319279 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:49.322830 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:49.356091 18488 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.358013 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.358803 18445 raft_consensus.cc:2393] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 3: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:49.290489 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.319597 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:49.360122 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:49.360435 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 78063us
I20260204 08:59:49.360879 19109 raft_consensus.cc:2393] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 2: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:49.358175 18343 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:49.348538 18442 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.356997 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
W20260204 08:59:49.355232 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 114724us
I20260204 08:59:49.362812 18372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 688) took 1023 ms. Trace:
I20260204 08:59:49.248040 18371 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:49.363030 19050 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.359143 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:49.363327 18372 rpcz_store.cc:276] 0204 08:59:48.339192 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:49.079669 (+740477us) service_pool.cc:225] Handling call
0204 08:59:49.079943 (+ 274us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:49.080127 (+ 184us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 08:59:49.206021 (+125894us) log.cc:844] Serialized 14 byte log entry
0204 08:59:49.362456 (+156435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:49.362562 (+ 106us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:49.362600 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:49.362657 (+ 57us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:49.362761 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":191377,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":250707,"threads_started":2}
I20260204 08:59:49.143215 18519 rpcz_store.cc:276] 0204 08:59:47.519189 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:47.519730 (+ 541us) service_pool.cc:225] Handling call
0204 08:59:47.552477 (+ 32747us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:47.602875 (+ 50398us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:47.648228 (+ 45353us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:47.685323 (+ 37095us) log.cc:844] Serialized 26 byte log entry
0204 08:59:48.241577 (+556254us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:48.253668 (+ 12091us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.257434 (+ 3766us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:49.059990 (+802556us) raft_consensus.cc:1685] finished
0204 08:59:49.060009 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:49.073683 (+ 13674us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":128104,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9320,"thread_start_us":500505,"threads_started":1,"wal-append.queue_time_us":772353}
I20260204 08:59:49.364938 18488 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.198388 19783 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.271070 19629 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.288501 18491 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 08:59:49.402311 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 113894us
I20260204 08:59:49.248507 19628 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:49.403393 18491 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:49.294238 18444 raft_consensus.cc:1240] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:49.269014 19642 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:49.399197 19301 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:49.400187 18488 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.365235 18417 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.359143 19107 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
W20260204 08:59:49.361858 19868 log.cc:927] Time spent T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.076s user 0.001s sys 0.000s
I20260204 08:59:49.404742 18377 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:49.272138 19765 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.250607 19781 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:49.366102 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.325620 19739 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:49.502430 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.397531 19735 raft_consensus.cc:697] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:49.359414 19660 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.407548 18414 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:49.267976 19646 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:49.429569 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.430514 18491 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 08:59:49.510480 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 80092.1us
I20260204 08:59:49.433166 18488 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.272730 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:49.484671 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:49.248247 19756 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:49.517957 19756 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 08:59:49.491573 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 86965.1us
I20260204 08:59:49.491665 19301 consensus_queue.cc:1059] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:49.518258 19735 consensus_queue.cc:237] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.518893 19859 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 08:59:49.519686 19659 consensus_meta.cc:287] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.573s user 0.001s sys 0.007s
I20260204 08:59:49.519379 19859 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.520040 19659 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:49.520610 19828 log.cc:927] Time spent T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 1.000s user 0.002s sys 0.000s
I20260204 08:59:49.521988 19659 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.522334 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.522212 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.523339 19099 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:49.400094 19768 consensus_queue.cc:1048] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260204 08:59:49.365813 19649 consensus_queue.cc:237] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.498561 19628 raft_consensus.cc:697] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:49.366113 19831 raft_consensus.cc:2749] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:49.503100 19109 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:49.539904 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.543053 19760 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.519397 19791 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.537258 19824 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:49.540423 19631 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:49.366153 19633 raft_consensus.cc:2764] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260204 08:59:49.545172 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:49.397900 18520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 576) took 1025 ms. Trace:
I20260204 08:59:49.405704 19798 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:49.566439 18520 rpcz_store.cc:276] 0204 08:59:48.340434 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:48.384229 (+ 43795us) service_pool.cc:225] Handling call
0204 08:59:49.354733 (+970504us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b5400287654. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:49.365734 (+ 11001us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":191940352}
I20260204 08:59:49.572003 19798 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.572469 19798 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.573033 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.573691 19100 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:49.574550 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.575067 19100 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
W20260204 08:59:49.508867 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 101394us
I20260204 08:59:49.539427 19590 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.577080 19102 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
W20260204 08:59:49.511440 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 78356.7us
I20260204 08:59:49.578003 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.578115 19590 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.410383 19642 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.578661 19642 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.566038 19631 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.579679 19631 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.581321 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.582129 19100 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:49.582837 19100 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
I20260204 08:59:49.559207 19755 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.584775 19859 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.518370 19756 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.549512 19574 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.502556 18517 raft_consensus.cc:2393] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:49.515952 18491 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:49.323792 19767 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.552526 18516 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:49.592069 19767 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.275409 19681 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.593624 18442 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:49.594048 19681 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.594347 18522 raft_consensus.cc:2393] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:49.509517 19646 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.506040 19781 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.501330 19750 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:49.500038 19814 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:49.551505 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:49.529302 19794 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.528913 18374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 689) took 1189 ms. Trace:
I20260204 08:59:49.549943 18518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 570) took 1707 ms. Trace:
I20260204 08:59:49.523993 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.622704 18518 rpcz_store.cc:276] 0204 08:59:47.842802 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:48.530930 (+688128us) service_pool.cc:225] Handling call
0204 08:59:48.531186 (+ 256us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:48.822545 (+291359us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 08:59:49.020758 (+198213us) log.cc:844] Serialized 14 byte log entry
0204 08:59:49.111605 (+ 90847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:49.113011 (+ 1406us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:49.113064 (+ 53us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:49.410382 (+297318us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800212fe0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fcebe19dc91 00007fcebe1aa671 00007fceb530f2d6 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49
0204 08:59:49.549729 (+139347us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54002f6554. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:49.549775 (+ 46us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:49.549891 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":67,"prepare.queue_time_us":255552,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":1724,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":2754,"spinlock_wait_cycles":674209536,"thread_start_us":267618,"threads_started":2,"wal-append.queue_time_us":150499}
I20260204 08:59:49.524003 18448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 288) took 1964 ms. Trace:
I20260204 08:59:49.560163 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.531287 19697 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.625177 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:49.625906 18524 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.500285 19698 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:49.523569 19770 consensus_meta.cc:287] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.503s user 0.005s sys 0.002s
I20260204 08:59:49.525928 18446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47922 (request call id 606) took 1648 ms. Trace:
I20260204 08:59:49.542191 18443 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:49.541324 18373 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:49.503042 19629 raft_consensus.cc:2749] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:49.539585 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.367050 19675 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:49.618623 19814 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.565133 19108 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:49.642366 19814 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.642728 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:49.621868 19831 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:49.643854 19831 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.644225 19831 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.519552 19050 leader_election.cc:400] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5.
I20260204 08:59:49.565445 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.567494 18343 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 08:59:49.645753 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 126324us
I20260204 08:59:49.569165 19107 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:49.404672 19740 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.591346 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.599164 18340 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:49.600381 18414 leader_election.cc:400] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:49.647716 18414 leader_election.cc:403] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260204 08:59:49.645948 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 78544.7us
W20260204 08:59:49.648298 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 48072.9us
I20260204 08:59:49.578270 18488 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:49.594759 19104 raft_consensus.cc:2393] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
W20260204 08:59:49.614451 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 249281us
I20260204 08:59:49.614612 18370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 223) took 1295 ms. Trace:
I20260204 08:59:49.498737 19700 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260204 08:59:49.619464 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 103582us
I20260204 08:59:49.623982 19105 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.513417 19739 raft_consensus.cc:697] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:49.536207 19819 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.603677 19646 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:49.613636 19671 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:49.615090 19781 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:49.630928 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:49.621547 18374 rpcz_store.cc:276] 0204 08:59:48.339424 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:49.123977 (+784553us) service_pool.cc:225] Handling call
0204 08:59:49.124241 (+ 264us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:49.151355 (+ 27114us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:49.151386 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:49.151425 (+ 39us) raft_consensus.cc:1645] Marking committed up to 5
0204 08:59:49.151453 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:49.528698 (+377245us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b540029e854. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:49.528746 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:49.528861 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":61952896}
I20260204 08:59:49.649392 18370 rpcz_store.cc:276] 0204 08:59:48.321205 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:49.072221 (+751016us) service_pool.cc:225] Handling call
0204 08:59:49.107475 (+ 35254us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:49.354685 (+247210us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:49.614343 (+259658us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001cf054. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:49.614553 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":272152832}
I20260204 08:59:49.520591 19301 raft_consensus.cc:3055] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:49.664773 19301 raft_consensus.cc:740] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:49.646898 19100 raft_consensus.cc:606] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.636634 19631 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.639735 19794 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.618733 19824 raft_consensus.cc:697] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:49.619992 19750 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.632218 19856 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:49.647380 18377 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.648797 18343 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 08:59:49.708717 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 60013.1us
I20260204 08:59:49.624646 18448 rpcz_store.cc:276] 0204 08:59:47.559965 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:47.561096 (+ 1131us) service_pool.cc:225] Handling call
0204 08:59:47.561420 (+ 324us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:47.932424 (+371004us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:47.932550 (+ 126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:47.933591 (+ 1041us) log.cc:844] Serialized 26 byte log entry
0204 08:59:48.259044 (+325453us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:48.259077 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:48.259146 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:49.490743 (+1231597us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 08:59:49.523723 (+ 32980us) raft_consensus.cc:1685] finished
0204 08:59:49.523745 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:49.523946 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2417,"raft.queue_time_us":97326,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":14806,"spinlock_wait_cycles":7039232,"thread_start_us":693416,"threads_started":2,"wal-append.queue_time_us":487307}
W20260204 08:59:49.647505 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 48430.1us
I20260204 08:59:49.650305 18525 raft_consensus.cc:1240] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:49.649585 18417 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.652498 19050 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 08:59:49.710987 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 58558.4us
I20260204 08:59:49.657171 18491 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:49.631305 19099 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
W20260204 08:59:49.711947 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 54876.7us
I20260204 08:59:49.713325 18491 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:49.660197 18524 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:49.665490 19301 consensus_queue.cc:260] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:49.713924 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 64231.6us
I20260204 08:59:49.714344 19301 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.645170 19675 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.654232 19791 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260204 08:59:49.635313 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:49.654639 19644 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:49.654487 19633 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:49.712936 19856 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.628737 18446 rpcz_store.cc:276] 0204 08:59:47.877526 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:48.019730 (+142204us) service_pool.cc:225] Handling call
0204 08:59:49.525767 (+1506037us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54002a3854. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:49.525874 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2260837632}
I20260204 08:59:49.650372 19700 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:49.720279 19700 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.713003 19738 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:49.721652 19738 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.721973 19738 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.644965 19628 consensus_queue.cc:237] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.668723 19671 raft_consensus.cc:697] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:49.690693 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.703460 18198 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48000 (request call id 205) took 4704 ms. Trace:
I20260204 08:59:49.704876 18197 catalog_manager.cc:5654] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:49.707113 19109 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:49.734086 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.710635 19105 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:49.711407 18343 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:49.658826 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 80637.7us
I20260204 08:59:49.714876 18414 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:49.736846 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.737499 19109 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.737756 18488 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.717526 19675 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:49.718175 19791 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.718521 19660 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:49.670080 18517 raft_consensus.cc:1240] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:49.735533 18198 rpcz_store.cc:276] 0204 08:59:44.999474 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:44.999583 (+ 109us) service_pool.cc:225] Handling call
0204 08:59:45.010813 (+ 11230us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b54001c2ad4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83590c0 00007fceb83f7bba 00007fcebe180eac 00007fcebe27b10e 00007fcebc7764a4 00007fcebc776432 00007fcebc776361 00007fcebc7762dc 00007fcebc775592 00007fceb672e34c 00007fceb672d786
0204 08:59:49.703400 (+4692587us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 08:59:46.550454 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 08:59:46.595686 (+ 45232us) write_op.cc:432] Acquiring schema lock in shared mode
0204 08:59:46.595724 (+ 38us) write_op.cc:435] Acquired schema lock
0204 08:59:46.595741 (+ 17us) tablet.cc:660] Decoding operations
0204 08:59:46.597600 (+ 1859us) write_op.cc:620] Acquiring the partition lock for write op
0204 08:59:46.597673 (+ 73us) write_op.cc:641] Partition lock acquired for write op
0204 08:59:46.597699 (+ 26us) tablet.cc:683] Acquiring locks for 4 operations
0204 08:59:46.598079 (+ 380us) tablet.cc:699] Row locks acquired
0204 08:59:46.598097 (+ 18us) write_op.cc:260] PREPARE: finished
0204 08:59:46.598241 (+ 144us) write_op.cc:270] Start()
0204 08:59:46.598358 (+ 117us) write_op.cc:276] Timestamp: P: 1770195586598204 usec, L: 0
0204 08:59:46.598380 (+ 22us) op_driver.cc:348] REPLICATION: starting
0204 08:59:46.826930 (+228550us) log.cc:844] Serialized 1693 byte log entry
0204 08:59:48.772202 (+1945272us) op_driver.cc:464] REPLICATION: finished
0204 08:59:49.109978 (+337776us) write_op.cc:301] APPLY: starting
0204 08:59:49.110076 (+ 98us) tablet.cc:1365] starting BulkCheckPresence
0204 08:59:49.117271 (+ 7195us) tablet.cc:1368] finished BulkCheckPresence
0204 08:59:49.149847 (+ 32576us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 08:59:49.212236 (+ 62389us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 08:59:49.212418 (+ 182us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0204 08:59:49.212465 (+ 47us) write_op.cc:312] APPLY: finished
0204 08:59:49.216872 (+ 4407us) log.cc:844] Serialized 40 byte log entry
0204 08:59:49.219211 (+ 2339us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:49.222282 (+ 3071us) write_op.cc:454] Released schema lock
0204 08:59:49.222339 (+ 57us) write_op.cc:341] FINISH: Updating metrics
0204 08:59:49.222681 (+ 342us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:49.222726 (+ 45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":19927936,"child_traces":[["op",{"apply.queue_time_us":305836,"apply.run_cpu_time_us":2667,"apply.run_wall_time_us":117074,"num_ops":4,"prepare.queue_time_us":100405,"prepare.run_cpu_time_us":58658,"prepare.run_wall_time_us":1261879,"raft.queue_time_us":241595,"raft.run_cpu_time_us":22583,"raft.run_wall_time_us":431020,"replication_time_us":2067330,"thread_start_us":1275270,"threads_started":4,"wal-append.queue_time_us":1193615}]]}
I20260204 08:59:49.749607 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:49.750319 18517 raft_consensus.cc:2393] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:49.751957 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:49.752668 19765 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:49.753163 19765 raft_consensus.cc:697] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:49.735163 19770 consensus_queue.cc:1059] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260204 08:59:49.727183 18448 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:49.753760 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.703224 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.754398 18369 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:49.754897 19109 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:49.716097 19835 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:49.723493 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.729060 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.692849 19631 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.689570 19697 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.760052 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.689073 19642 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.699784 19698 raft_consensus.cc:2749] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:49.733188 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.733441 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.734071 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.736322 18197 catalog_manager.cc:5654] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 2 to 3, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 3 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:49.664058 19676 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:49.738911 18488 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.739856 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.773631 19099 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:49.774114 18368 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
W20260204 08:59:49.774283 19104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46720 (request call id 635) took 1469 ms (client timeout 1668 ms). Trace:
I20260204 08:59:49.743554 18343 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.745302 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.745982 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.739874 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.746985 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.747100 19660 raft_consensus.cc:697] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:49.747987 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.748212 19831 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.743964 19791 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.714651 18417 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.753572 19105 raft_consensus.cc:1275] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260204 08:59:49.670460 19100 raft_consensus.cc:614] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 08:59:49.731022 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:49.788594 18518 raft_consensus.cc:2393] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:49.756074 18491 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:49.715552 19873 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:49.732642 18377 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:49.697991 19798 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.797032 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.742041 19574 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:49.767668 18197 catalog_manager.cc:5654] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 3 to 4, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:49.735103 19644 raft_consensus.cc:697] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:49.741083 19747 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.770430 18488 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.736202 19050 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:49.772496 19836 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.825873 19644 consensus_queue.cc:237] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.821735 19100 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.773173 19765 consensus_queue.cc:237] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.763883 19633 consensus_queue.cc:1059] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260204 08:59:49.832232 19633 raft_consensus.cc:3055] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:49.736210 18374 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:49.687918 19739 consensus_queue.cc:237] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.832444 19750 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:49.833856 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 63494.6us
I20260204 08:59:49.834770 19100 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:49.835242 19574 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.835610 19574 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:49.777458 19824 consensus_queue.cc:237] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.836464 19747 raft_consensus.cc:2749] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:49.837164 19633 raft_consensus.cc:740] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:49.838714 19633 consensus_queue.cc:260] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.842175 19633 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.793851 19756 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.843499 19574 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.844214 19756 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:49.839303 19876 log.cc:927] Time spent T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260204 08:59:49.835695 19642 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.834632 19646 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.845836 19738 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.847088 18372 raft_consensus.cc:2393] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:49.847280 18491 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:49.847749 19646 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.848961 19574 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.849639 19738 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.850287 19836 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:49.823254 19099 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
from {username='slave'} at 127.0.0.1:41020
I20260204 08:59:49.850847 19791 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.852375 18373 raft_consensus.cc:2368] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5.
I20260204 08:59:49.836267 18488 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:49.853267 19791 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.853997 19814 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.856396 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.857393 18520 raft_consensus.cc:2393] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:49.857686 19100 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.757560 19649 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:49.765413 19850 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:49.758618 19835 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:49.780611 18376 raft_consensus.cc:2368] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4.
I20260204 08:59:49.786718 18343 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 08:59:49.786851 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 72279.1us
I20260204 08:59:49.790494 18414 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:49.786093 18371 raft_consensus.cc:2393] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:49.781919 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.791081 19629 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:49.791752 19660 consensus_queue.cc:237] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.792258 19831 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.778420 19768 consensus_queue.cc:1059] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260204 08:59:49.786151 18516 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:49.796144 19740 consensus_queue.cc:1048] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:49.890460 19629 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.798010 19697 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:49.766669 18375 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:49.876672 19850 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:49.883617 19659 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:49.894536 19850 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.894814 19659 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.781765 19764 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:49.796322 19755 raft_consensus.cc:3055] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:49.767354 19671 consensus_queue.cc:237] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:49.799377 19856 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.777742 19676 raft_consensus.cc:697] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:49.906571 19659 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.906386 19676 consensus_queue.cc:237] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.790587 19819 raft_consensus.cc:2749] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260204 08:59:49.774718 19104 rpcz_store.cc:269] 0204 08:59:48.304898 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:48.306822 (+ 1924us) service_pool.cc:225] Handling call
0204 08:59:49.774076 (+1467254us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540000cdd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:49.774233 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2810010880}
I20260204 08:59:49.821848 18197 catalog_manager.cc:5654] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 2, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 2 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
W20260204 08:59:49.824465 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 88346.9us
I20260204 08:59:49.824550 19301 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:49.878422 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 08:59:49.878788 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 88373.9us
I20260204 08:59:49.914371 19301 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:49.915040 19301 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.879431 18417 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.894459 19768 raft_consensus.cc:3055] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:49.859040 19798 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.888345 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 08:59:49.893514 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 106864us
I20260204 08:59:49.926653 18343 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.855554 19814 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:49.882750 19835 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.883695 19646 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:49.850850 19836 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:49.892468 19629 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:49.912001 19740 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:49.860649 19675 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:49.920172 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.946947 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:49.920854 18448 raft_consensus.cc:2393] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:49.947528 19105 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.863318 18488 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:49.922187 19301 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.863317 19781 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.896384 19649 raft_consensus.cc:697] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:49.924877 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.928613 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:49.928822 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 49460.1us
W20260204 08:59:49.949903 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 86662.8us
I20260204 08:59:49.950382 19301 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:49.950764 18417 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.898788 19756 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:49.931528 19050 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:49.897527 19755 raft_consensus.cc:740] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:49.894814 19697 raft_consensus.cc:697] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:49.893608 19698 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:49.952939 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.965440 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.953584 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.954217 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.966820 18375 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.949939 19107 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:49.968402 18447 raft_consensus.cc:2393] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:49.945457 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:49.956786 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:49.957230 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.971261 18377 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:49.971740 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.975078 19107 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:49.958968 18417 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:49.923564 19768 raft_consensus.cc:740] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:49.959076 19301 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:49.977502 19301 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:49.977845 19301 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:49.949397 19836 raft_consensus.cc:697] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:49.960547 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.989768 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.960839 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.990953 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:49.932502 19873 raft_consensus.cc:2749] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:49.946321 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:49.970234 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:49.955299 18340 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.976437 18377 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:49.949209 19646 raft_consensus.cc:697] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:49.961396 19824 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:49.976600 18417 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.959156 19764 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:49.971228 18374 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 1.
I20260204 08:59:49.959139 19050 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:49.972293 18521 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:49.979615 18343 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:49.984242 18369 raft_consensus.cc:1275] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:49.967772 19100 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:49.984822 19649 consensus_queue.cc:237] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.985337 19301 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:49.986712 19675 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:49.963244 19631 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:49.994494 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:49.943907 19770 consensus_queue.cc:1059] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260204 08:59:49.994139 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:50.030606 18491 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:50.001287 18375 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:49.967046 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:50.004431 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 49215.9us
I20260204 08:59:50.033310 18340 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:50.006585 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:49.970499 19698 raft_consensus.cc:697] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:50.011219 19781 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.017331 19628 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:50.037214 18340 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:49.967217 19756 raft_consensus.cc:697] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:50.012603 18417 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:50.012616 18525 raft_consensus.cc:2368] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3.
I20260204 08:59:49.998430 19105 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:49.970762 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:50.040570 18343 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:49.984619 19768 consensus_queue.cc:260] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:50.029554 19884 log.cc:927] Time spent T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.107s user 0.001s sys 0.000s
I20260204 08:59:50.018877 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.044891 19107 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
W20260204 08:59:50.017135 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 58083.6us
I20260204 08:59:49.958354 19740 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:49.992894 19633 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:50.011683 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:50.023974 18488 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:50.027837 19301 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:50.013957 18516 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:50.034320 18377 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 1 FOLLOWER]: Advancing to term 3
W20260204 08:59:50.172744 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 148859us
I20260204 08:59:50.173468 18488 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:49.978909 19700 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.022383 19791 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:50.022094 19750 raft_consensus.cc:2764] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260204 08:59:50.018890 19653 raft_consensus.cc:2749] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:50.154384 19821 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
W20260204 08:59:50.170656 19800 log.cc:927] Time spent T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: Append to log took a long time: real 0.143s user 0.001s sys 0.000s
I20260204 08:59:50.041260 18340 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:50.023310 19824 raft_consensus.cc:697] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:50.022579 19764 raft_consensus.cc:697] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:50.035073 19697 consensus_queue.cc:237] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.049258 19768 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:50.176970 19831 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 08:59:50.195943 18488 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.3.195:40161 timed out after 1.654s (SENT) [suppressed 12 similar messages]
I20260204 08:59:50.196260 19107 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 08:59:50.191766 19821 raft_consensus.cc:697] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:50.028472 19631 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 08:59:50.121850 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 109324us
I20260204 08:59:50.201879 19821 consensus_queue.cc:237] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.193112 19756 consensus_queue.cc:237] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:50.152879 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:50.035317 19798 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:50.042145 19765 raft_consensus.cc:2749] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260204 08:59:50.158641 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:50.189237 19791 raft_consensus.cc:697] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:50.050066 19794 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:50.026100 19755 consensus_queue.cc:260] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.126397 19660 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:50.159729 19739 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:50.151677 19783 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:50.124943 19814 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.014479 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:50.160910 19781 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:50.170401 19633 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:50.178697 19747 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:50.206009 19109 raft_consensus.cc:1240] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:50.047298 19050 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:50.206904 18522 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
W20260204 08:59:50.232259 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 185030us
I20260204 08:59:50.161489 18414 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:50.214112 19107 raft_consensus.cc:1240] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260204 08:59:50.221035 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:50.221208 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.234189 19105 raft_consensus.cc:2393] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:50.191365 19590 consensus_queue.cc:1048] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260204 08:59:50.199572 19745 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:50.152351 19646 consensus_queue.cc:237] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:50.227468 18524 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:50.156181 19836 consensus_queue.cc:237] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.190418 19698 consensus_queue.cc:237] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.235241 19050 leader_election.cc:400] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5.
I20260204 08:59:50.242812 19050 leader_election.cc:403] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260204 08:59:50.243961 19050 leader_election.cc:400] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4.
I20260204 08:59:50.244257 19050 leader_election.cc:403] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:50.239451 19770 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:50.244773 19856 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4.
I20260204 08:59:50.244812 19770 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:50.245116 19050 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:50.205801 19798 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.199004 19824 consensus_queue.cc:237] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.224613 19794 raft_consensus.cc:697] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:50.229691 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.244109 19301 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5.
I20260204 08:59:50.240336 19873 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:50.235860 19739 raft_consensus.cc:697] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:50.227440 19660 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:50.266323 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.269057 19850 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:50.272002 19740 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.249768 19770 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:50.261771 19747 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:50.273226 19798 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:50.251261 19767 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:50.313827 19767 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:50.314204 19767 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.317447 19850 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:50.256984 19883 log.cc:927] Time spent T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.097s user 0.001s sys 0.000s
W20260204 08:59:50.275458 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:50.278404 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:50.323200 19107 raft_consensus.cc:2368] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6.
I20260204 08:59:50.255273 19653 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 08:59:50.235414 19781 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:50.235188 19814 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.290817 19101 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.288585 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:50.260144 19764 consensus_queue.cc:237] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.310003 19700 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.290807 19873 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:50.308432 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.262650 19791 consensus_queue.cc:237] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.215021 19631 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.240415 19633 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.288113 19794 consensus_queue.cc:237] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.322547 19747 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.368918 19814 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.372557 19873 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:50.375404 19835 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.377728 19835 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:50.426486 18197 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47988 (request call id 241) took 3959 ms. Trace:
I20260204 08:59:50.489526 18491 leader_election.cc:400] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6.
I20260204 08:59:50.303087 18524 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:50.435133 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:50.492146 18371 raft_consensus.cc:2393] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:50.436518 18376 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:50.322854 18517 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.186489 18377 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:50.014396 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:50.233489 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 72106.6us
I20260204 08:59:50.498421 18374 raft_consensus.cc:2393] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:50.490070 18491 leader_election.cc:403] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:50.508716 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:50.484344 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 288318us
I20260204 08:59:50.491056 18519 raft_consensus.cc:2368] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4.
I20260204 08:59:50.519927 18517 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:50.523497 18516 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 08:59:50.524610 18375 raft_consensus.cc:1275] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:50.525353 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:50.340184 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 91330.1us
I20260204 08:59:50.338940 19105 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:50.431370 18196 catalog_manager.cc:5654] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:50.486356 18197 rpcz_store.cc:276] 0204 08:59:46.466414 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.466773 (+ 359us) service_pool.cc:225] Handling call
0204 08:59:50.426202 (+3959429us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 08:59:49.995887 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 08:59:50.007107 (+ 11220us) write_op.cc:432] Acquiring schema lock in shared mode
0204 08:59:50.007143 (+ 36us) write_op.cc:435] Acquired schema lock
0204 08:59:50.007160 (+ 17us) tablet.cc:660] Decoding operations
0204 08:59:50.007816 (+ 656us) write_op.cc:620] Acquiring the partition lock for write op
0204 08:59:50.007899 (+ 83us) write_op.cc:641] Partition lock acquired for write op
0204 08:59:50.007928 (+ 29us) tablet.cc:683] Acquiring locks for 4 operations
0204 08:59:50.008300 (+ 372us) tablet.cc:699] Row locks acquired
0204 08:59:50.008317 (+ 17us) write_op.cc:260] PREPARE: finished
0204 08:59:50.008463 (+ 146us) write_op.cc:270] Start()
0204 08:59:50.008573 (+ 110us) write_op.cc:276] Timestamp: P: 1770195590008425 usec, L: 0
0204 08:59:50.008593 (+ 20us) op_driver.cc:348] REPLICATION: starting
0204 08:59:50.009778 (+ 1185us) log.cc:844] Serialized 1693 byte log entry
0204 08:59:50.370738 (+360960us) op_driver.cc:464] REPLICATION: finished
0204 08:59:50.386576 (+ 15838us) write_op.cc:301] APPLY: starting
0204 08:59:50.386636 (+ 60us) tablet.cc:1365] starting BulkCheckPresence
0204 08:59:50.386733 (+ 97us) tablet.cc:1368] finished BulkCheckPresence
0204 08:59:50.386810 (+ 77us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 08:59:50.387245 (+ 435us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 08:59:50.387364 (+ 119us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0204 08:59:50.387390 (+ 26us) write_op.cc:312] APPLY: finished
0204 08:59:50.387551 (+ 161us) log.cc:844] Serialized 40 byte log entry
0204 08:59:50.387683 (+ 132us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:50.387767 (+ 84us) write_op.cc:454] Released schema lock
0204 08:59:50.387798 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0204 08:59:50.388025 (+ 227us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:50.388047 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147515,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":15614,"apply.run_cpu_time_us":1456,"apply.run_wall_time_us":1456,"num_ops":4,"prepare.queue_time_us":51601,"prepare.run_cpu_time_us":3590,"prepare.run_wall_time_us":14160,"replication_time_us":362003,"thread_start_us":66579,"threads_started":2}]]}
I20260204 08:59:50.537190 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:50.553689 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 511877us
I20260204 08:59:50.557337 18340 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:50.558449 19745 raft_consensus.cc:2764] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260204 08:59:50.354743 19739 consensus_queue.cc:237] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.562441 18373 raft_consensus.cc:2368] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6.
I20260204 08:59:50.562703 19700 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 6
I20260204 08:59:50.564976 18340 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:50.566103 19745 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 08:59:50.569140 19781 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:50.569558 18340 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:50.570993 19642 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 08:59:50.572242 19660 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:50.575188 18340 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:50.576349 19642 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:50.578593 18340 leader_election.cc:400] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3.
I20260204 08:59:50.587710 18340 leader_election.cc:403] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:50.589051 19642 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3.
W20260204 08:59:50.588479 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 410122us
I20260204 08:59:50.592494 18340 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:50.595912 19642 raft_consensus.cc:2749] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:50.610986 19814 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.612047 19814 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:50.616673 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 71831.6us
I20260204 08:59:50.619333 19747 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:50.619920 19760 raft_consensus.cc:3055] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:50.620327 19760 raft_consensus.cc:740] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:50.621439 19760 consensus_queue.cc:260] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.621917 19631 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.624137 19106 raft_consensus.cc:1275] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260204 08:59:50.624614 19800 log.cc:927] Time spent T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: Append to log took a long time: real 0.069s user 0.000s sys 0.001s
I20260204 08:59:50.625406 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:50.625865 19106 raft_consensus.cc:1275] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:50.626224 19104 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:50.627317 19106 raft_consensus.cc:3055] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:50.629828 19106 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:50.631103 19106 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.627863 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.632375 19106 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:50.632535 19102 raft_consensus.cc:2393] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:50.627983 19898 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:50.636034 19898 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.638190 19750 consensus_queue.cc:1059] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:50.638542 19898 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:50.628635 19301 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:50.629452 19760 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:50.628556 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:50.639362 18376 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 08:59:50.655552 19301 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.656415 19106 raft_consensus.cc:1275] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260204 08:59:50.656841 19106 pending_rounds.cc:85] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Aborting all ops after (but not including) 3
I20260204 08:59:50.657080 19106 pending_rounds.cc:107] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260204 08:59:50.657388 19106 raft_consensus.cc:2889] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:50.657892 19301 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:50.658545 18525 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
W20260204 08:59:50.663744 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 65696us
I20260204 08:59:50.665736 18448 raft_consensus.cc:1275] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:50.666952 18414 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:50.668984 18196 catalog_manager.cc:5654] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 4, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 4 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:50.665726 19700 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6.
I20260204 08:59:50.645474 19898 consensus_queue.cc:1059] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260204 08:59:50.704813 19824 consensus_queue.cc:1048] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:50.705515 19633 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.706178 19898 raft_consensus.cc:3055] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:50.706583 19898 raft_consensus.cc:740] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:50.613886 19767 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.707883 19631 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.697244 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:50.679138 18414 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:50.684931 18196 catalog_manager.cc:5654] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:50.688192 19109 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:50.691025 18488 leader_election.cc:400] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6.
I20260204 08:59:50.693411 19740 consensus_queue.cc:1048] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:50.696362 18343 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:50.682309 19814 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.697197 19050 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:50.697973 19301 consensus_queue.cc:1059] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:50.700148 19101 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:50.702793 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.703019 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:50.686928 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:50.704890 18491 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:50.697240 19819 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:50.724232 18491 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:50.726016 19835 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:50.726049 18491 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:50.726538 19835 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.726946 19835 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:50.686753 19747 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.727574 19747 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.728835 19100 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:50.729647 19747 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.724090 19653 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:50.711673 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:50.726779 19700 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260204 08:59:50.737608 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:50.709095 19770 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:50.726049 19768 consensus_meta.cc:287] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.532s user 0.008s sys 0.004s
I20260204 08:59:50.733783 19653 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:50.752225 19107 raft_consensus.cc:1275] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:50.752779 19750 raft_consensus.cc:3055] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:50.753355 19698 consensus_queue.cc:1048] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260204 08:59:50.736421 19819 raft_consensus.cc:697] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 6 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:50.750056 19767 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:50.754985 18443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39114 (request call id 316) took 1010 ms. Trace:
I20260204 08:59:50.755411 19671 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:50.756651 19755 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.757642 19856 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:50.758191 18343 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:50.769742 18374 raft_consensus.cc:1240] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
W20260204 08:59:50.739965 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 49119.6us
I20260204 08:59:50.727151 19814 consensus_queue.cc:1048] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260204 08:59:50.746723 19739 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:50.711795 19898 consensus_queue.cc:260] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.748067 19859 raft_consensus.cc:3055] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:50.752646 19633 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.747107 19735 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 08:59:50.767845 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 88796us
I20260204 08:59:50.762398 19653 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:50.762099 19750 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:50.763002 19631 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.771981 18491 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:50.768741 19671 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:50.773273 19859 raft_consensus.cc:740] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:50.780109 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:50.780735 18525 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.782249 19675 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260204 08:59:50.783025 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:50.778940 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:50.788120 19631 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.790223 19631 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.792627 18525 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:50.780601 19859 consensus_queue.cc:260] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.806273 19700 raft_consensus.cc:2764] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260204 08:59:50.806984 19108 raft_consensus.cc:1275] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:50.808449 19105 raft_consensus.cc:1240] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:50.778007 19739 raft_consensus.cc:697] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:50.797369 19819 consensus_queue.cc:237] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:50.783329 19735 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.817056 19735 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.817561 19770 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:50.800428 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:50.818455 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 60429.7us
I20260204 08:59:50.805555 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:50.805840 19101 raft_consensus.cc:1240] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:50.796145 19750 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.779342 19671 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.766357 18443 rpcz_store.cc:276] 0204 08:59:49.744470 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:49.751695 (+ 7225us) service_pool.cc:225] Handling call
0204 08:59:50.748667 (+996972us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54006a4fd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:50.754793 (+ 6126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1861169408}
I20260204 08:59:50.799021 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:50.779618 19100 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:50.786595 19768 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.824211 19739 consensus_queue.cc:237] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.825139 18444 raft_consensus.cc:1275] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:50.824213 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:50.831171 18450 raft_consensus.cc:1275] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 08:59:50.823009 19814 consensus_queue.cc:1059] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260204 08:59:50.835754 18451 raft_consensus.cc:1240] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:50.838815 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:50.839787 18445 raft_consensus.cc:2410] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260204 08:59:50.840137 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:50.840842 18449 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:50.840765 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:50.841697 18445 raft_consensus.cc:2368] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4.
I20260204 08:59:50.841727 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:50.851969 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:50.852703 18448 raft_consensus.cc:2368] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4.
I20260204 08:59:50.853296 19750 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.856173 19859 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.856359 19814 raft_consensus.cc:3055] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 08:59:50.856727 19814 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:50.857486 19814 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:50.858805 19814 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:50.851984 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:50.862560 19898 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:50.868297 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 48665.3us
I20260204 08:59:50.870699 19791 consensus_queue.cc:1048] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260204 08:59:50.872824 18449 raft_consensus.cc:2376] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5. Re-sending same reply.
I20260204 08:59:50.873927 18443 raft_consensus.cc:1275] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:50.874508 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:50.875728 19101 raft_consensus.cc:1240] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:50.877206 19107 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:50.880998 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.881616 19104 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.883562 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:50.884181 19106 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.885062 19101 raft_consensus.cc:1240] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:50.886484 19101 raft_consensus.cc:1240] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:50.891047 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:50.891822 19100 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:50.893601 19735 consensus_queue.cc:1059] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:50.894459 19735 raft_consensus.cc:3055] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:50.895219 19735 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:50.896864 19735 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.899308 19735 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
W20260204 08:59:50.903810 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 74940.5us
I20260204 08:59:50.905710 19631 consensus_queue.cc:1059] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:50.906437 19631 consensus_queue.cc:1243] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer 44601d9bf1ce4a70a5b01dcfc505d276 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260204 08:59:50.906658 19109 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:50.906925 19631 raft_consensus.cc:3055] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:50.907434 19631 raft_consensus.cc:740] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:50.907766 19106 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:50.908351 19631 consensus_queue.cc:260] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.910367 19631 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:50.914968 19698 consensus_queue.cc:1048] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:50.916987 19698 consensus_queue.cc:1059] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:50.917161 18491 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:50.919003 19836 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:50.919453 19836 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.919905 19836 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:50.931052 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 234119us
I20260204 08:59:50.908015 18414 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:50.937485 18447 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:50.798187 19835 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:50.948824 19107 raft_consensus.cc:1275] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260204 08:59:50.954975 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 47032.7us
I20260204 08:59:50.959496 19106 raft_consensus.cc:1275] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:50.956669 19633 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.960546 19633 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.962406 19633 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:50.947839 19631 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:50.963276 19675 consensus_queue.cc:1048] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:50.963980 19104 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:50.969672 18414 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:50.845073 19768 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.977761 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:50.979921 18447 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
W20260204 08:59:50.984876 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 179776us
I20260204 08:59:50.985986 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:50.973958 18516 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:50.981086 18443 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:50.991525 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:50.996866 18415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:50.997283 18374 raft_consensus.cc:2393] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 3: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:50.990044 19642 consensus_queue.cc:1048] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260204 08:59:50.997592 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:50.991307 19649 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:50.991221 19890 consensus_queue.cc:1048] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260204 08:59:50.998816 19649 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.000005 19794 consensus_queue.cc:1048] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260204 08:59:51.000982 19649 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:50.997033 19893 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:51.002123 19893 raft_consensus.cc:697] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:50.991312 18517 raft_consensus.cc:2393] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:50.999258 19850 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.008929 19850 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:50.995236 18519 raft_consensus.cc:1275] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:51.010977 19850 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:51.010726 19893 consensus_queue.cc:237] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.018589 19107 raft_consensus.cc:1275] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:51.019595 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.019759 19675 consensus_queue.cc:1048] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:51.020218 19698 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:51.020838 19698 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.021467 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:51.022466 18522 raft_consensus.cc:1275] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260204 08:59:51.022840 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.022945 19698 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.024506 18517 raft_consensus.cc:1275] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:51.032028 19850 consensus_queue.cc:1048] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:51.032593 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.027266 18488 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:51.036234 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.050663 19633 consensus_queue.cc:1048] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:51.052716 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:51.057868 18340 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:51.061115 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.063856 18516 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
W20260204 08:59:51.066334 19918 log.cc:927] Time spent T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260204 08:59:51.067262 19099 raft_consensus.cc:606] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Received request to transfer leadership to TS 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:51.067818 19099 raft_consensus.cc:614] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 08:59:51.068630 19105 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:51.069787 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:51.072170 19819 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:51.074009 19824 raft_consensus.cc:3055] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:51.074395 19824 raft_consensus.cc:740] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:51.074559 19698 raft_consensus.cc:2749] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:51.077184 19738 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:51.078387 19099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41020 (request call id 2) took 1277 ms. Trace:
I20260204 08:59:51.078717 19099 rpcz_store.cc:276] 0204 08:59:49.800784 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:49.817939 (+ 17155us) service_pool.cc:225] Handling call
0204 08:59:51.078163 (+1260224us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540000a5d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83e94d3 00007fcebd3af13a 00007fceb6942934 00007fceb69428c2 00007fceb69427f1 00007fceb694276c 00007fceb6941a22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:51.078303 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2795407744}
I20260204 08:59:51.080374 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260204 08:59:51.082741 19768 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:51.083298 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 08:59:51.075196 19824 consensus_queue.cc:260] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.084317 19824 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:51.085609 18343 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:51.086879 19105 raft_consensus.cc:1275] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:51.089109 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:51.090158 18516 raft_consensus.cc:2410] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260204 08:59:51.090610 19653 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:51.089133 19671 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.086740 19675 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:51.084388 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:51.095706 18524 raft_consensus.cc:2393] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:51.098383 19675 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.104223 19675 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:51.105268 19105 raft_consensus.cc:1240] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 6. Ops: []
I20260204 08:59:51.106690 19644 consensus_queue.cc:1048] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260204 08:59:51.107122 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 78682.7us
I20260204 08:59:51.107856 18372 raft_consensus.cc:1275] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:51.110314 19104 raft_consensus.cc:1275] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:51.107892 18417 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:51.116663 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:51.117362 19653 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:51.117990 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.131991 18414 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:51.131991 19106 raft_consensus.cc:2410] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260204 08:59:51.137974 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:51.138844 19104 raft_consensus.cc:2368] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4.
I20260204 08:59:51.141196 18491 leader_election.cc:400] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4.
I20260204 08:59:51.141520 18491 leader_election.cc:403] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260204 08:59:51.144176 18417 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:51.145290 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:51.150789 18417 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:51.151214 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 158703us
I20260204 08:59:51.155541 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:51.147892 18442 raft_consensus.cc:1240] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260204 08:59:51.148253 19814 raft_consensus.cc:2749] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4.
I20260204 08:59:51.092552 19893 consensus_queue.cc:1048] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260204 08:59:51.165422 19745 consensus_queue.cc:1059] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260204 08:59:51.169673 19745 raft_consensus.cc:3055] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:51.169983 19745 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:51.158476 19781 consensus_queue.cc:1059] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260204 08:59:51.170944 19781 raft_consensus.cc:3055] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:51.170795 19745 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:51.171341 19781 raft_consensus.cc:740] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:51.172042 19745 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 6
I20260204 08:59:51.172215 19781 consensus_queue.cc:260] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.146829 19835 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.186018 18372 raft_consensus.cc:2393] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 3: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:51.148118 19836 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.167733 19653 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:51.195788 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:51.196194 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.198016 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.161834 19633 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:51.203883 19106 raft_consensus.cc:1275] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:51.180434 19768 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:51.203482 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:51.204658 18417 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:51.214845 18525 raft_consensus.cc:1240] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:51.191802 18446 raft_consensus.cc:1275] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260204 08:59:51.165441 19646 consensus_queue.cc:1059] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260204 08:59:51.220518 19106 raft_consensus.cc:1275] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:51.224107 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.224745 19105 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:51.219377 18446 pending_rounds.cc:85] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: Aborting all ops after (but not including) 3
W20260204 08:59:51.225093 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 108900us
W20260204 08:59:51.227260 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 69083.5us
I20260204 08:59:51.212427 19102 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:51.220420 19819 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:51.233608 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.233907 19821 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:51.234941 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:51.235713 19873 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260204 08:59:51.236318 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.223896 19781 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:51.243757 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:51.216706 19891 consensus_queue.cc:1048] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260204 08:59:51.228173 18446 pending_rounds.cc:107] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260204 08:59:51.230540 19671 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.250505 19873 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.220528 19768 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.256736 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:51.268782 18524 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:51.254745 19105 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:51.263067 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:51.264724 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:51.254738 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 46704.9us
I20260204 08:59:51.268286 18488 leader_election.cc:400] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Vote denied by peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161) with higher term. Message: Invalid argument: T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4.
I20260204 08:59:51.256126 19756 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:51.261771 19821 raft_consensus.cc:697] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:51.265301 19646 raft_consensus.cc:3055] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:51.256950 18446 raft_consensus.cc:2889] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:51.260694 19653 raft_consensus.cc:697] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:51.269409 19873 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:51.257737 19814 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.290244 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:51.286974 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.251988 19893 consensus_queue.cc:1048] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260204 08:59:51.335778 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:51.336585 18520 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:51.337953 19893 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.338490 19893 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.321076 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:51.290489 19756 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.324738 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.276206 19735 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.325520 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:51.342793 18451 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
W20260204 08:59:51.330845 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 97823.5us
I20260204 08:59:51.340869 18488 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:51.347309 18372 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:51.290141 19646 raft_consensus.cc:740] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:51.341221 19633 raft_consensus.cc:697] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:51.386682 18376 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:51.285158 19819 consensus_queue.cc:1048] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260204 08:59:51.391808 18374 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:51.389364 19836 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.347750 19735 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:51.436241 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 147141us
I20260204 08:59:51.389853 19747 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.391222 19671 raft_consensus.cc:2749] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:51.391371 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:51.343297 19814 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.398012 19755 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:51.443969 18488 leader_election.cc:400] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161) with higher term. Message: Invalid argument: T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4.
I20260204 08:59:51.441251 19050 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:51.469123 19755 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.484056 19755 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:51.485025 19913 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:51.486006 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:51.487278 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 57829.6us
W20260204 08:59:51.488426 19932 log.cc:927] Time spent T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.201s user 0.000s sys 0.000s
W20260204 08:59:51.489144 19927 log.cc:927] Time spent T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260204 08:59:51.489689 19050 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:51.490201 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:51.504140 19109 raft_consensus.cc:1275] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260204 08:59:51.505077 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 61240.2us
I20260204 08:59:51.518594 19105 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:51.511416 18372 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:51.514659 18524 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:51.460330 19768 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.482008 19814 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.454711 19821 consensus_queue.cc:237] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.460599 19747 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.479234 18520 raft_consensus.cc:1275] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 08:59:51.522496 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.484092 19835 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:51.491339 19893 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:51.509434 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:51.534403 18491 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:51.537951 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:51.537256 18414 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:51.542773 19671 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:51.543437 19698 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:51.543924 19698 raft_consensus.cc:697] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:51.544797 19698 consensus_queue.cc:237] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.549021 19873 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.549620 19642 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:51.550314 19675 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:51.550869 19945 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:51.551368 19945 raft_consensus.cc:697] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:51.525480 19755 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260204 08:59:51.553225 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.534773 19898 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:51.569052 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 140329us
I20260204 08:59:51.573894 18417 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 08:59:51.587893 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 50007.9us
I20260204 08:59:51.534194 18376 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:51.602530 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.603531 18444 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:51.490969 19653 consensus_queue.cc:237] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.551527 19747 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.603216 19108 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:51.506546 19646 consensus_queue.cc:260] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.539376 19819 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260204 08:59:51.614463 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 79457us
I20260204 08:59:51.559868 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:51.511533 19633 consensus_queue.cc:237] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.597292 19735 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:51.541975 19835 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:51.605933 19675 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.604717 19898 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.634771 19756 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:51.652156 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 142435us
I20260204 08:59:51.658190 19835 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:51.660154 19050 leader_election.cc:400] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765) with higher term. Message: Invalid argument: T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4.
W20260204 08:59:51.650840 19930 log.cc:927] Time spent T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.172s user 0.001s sys 0.000s
I20260204 08:59:51.651976 19951 consensus_queue.cc:1048] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260204 08:59:51.669569 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:51.669864 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 96809.3us
I20260204 08:59:51.670461 19108 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:51.671686 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.672864 19105 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:51.670945 18417 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:51.695719 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.695863 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.696946 18451 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 08:59:51.698308 18446 raft_consensus.cc:2393] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:51.691416 19735 consensus_queue.cc:1048] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260204 08:59:51.701484 19952 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:51.702869 19951 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:51.705747 19099 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:51.708329 19957 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:51.714296 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.722963 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.676790 19955 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:51.725834 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 108867us
I20260204 08:59:51.726330 18343 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 08:59:51.731575 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 80828.3us
W20260204 08:59:51.732064 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.696240 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:51.744632 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.747277 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:51.751950 18522 raft_consensus.cc:2393] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
W20260204 08:59:51.752138 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.728837 19768 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.755445 18343 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:51.759326 19964 consensus_queue.cc:1059] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260204 08:59:51.760710 19938 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.761726 19940 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:51.762120 19940 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.762454 19940 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:51.738099 19873 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.746951 18373 raft_consensus.cc:1275] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260204 08:59:51.766301 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 163459us
W20260204 08:59:51.756906 19936 log.cc:927] Time spent T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.260s user 0.000s sys 0.001s
I20260204 08:59:51.701941 19952 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.773921 19944 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:51.778766 19952 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:51.782145 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 134739us
I20260204 08:59:51.782820 18488 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:51.733824 19955 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.784853 19955 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.755066 19735 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:51.772179 18491 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:51.703395 19951 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.796172 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:51.800007 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 63744.3us
I20260204 08:59:51.761246 19938 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.802278 18417 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:51.802630 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.803233 18491 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:51.708833 19957 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:51.804673 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:51.798939 19050 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:51.808452 19100 raft_consensus.cc:2410] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260204 08:59:51.806190 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:51.811213 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.815470 18448 raft_consensus.cc:1275] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260204 08:59:51.786054 19890 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:51.778543 19964 raft_consensus.cc:3055] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:51.807593 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.819756 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:51.779508 19102 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
W20260204 08:59:51.821237 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.821892 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:51.657863 19945 consensus_queue.cc:237] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:51.822664 18375 raft_consensus.cc:1240] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:51.815896 18448 pending_rounds.cc:85] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Aborting all ops after (but not including) 1
I20260204 08:59:51.824172 18448 pending_rounds.cc:107] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260204 08:59:51.824419 18448 raft_consensus.cc:2889] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:51.769073 19768 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:51.822870 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:51.790570 19735 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.829010 19735 raft_consensus.cc:3060] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:51.830000 19944 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.830425 19944 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:51.825333 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:51.823911 18522 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:51.827514 19050 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:51.828521 18451 raft_consensus.cc:1275] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:51.839231 18417 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:51.859257 18450 raft_consensus.cc:2393] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
W20260204 08:59:51.862877 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 51894.5us
I20260204 08:59:51.818823 19755 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:51.810966 19791 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:51.822866 19747 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:51.822626 19671 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:51.792950 19835 consensus_queue.cc:1048] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260204 08:59:51.882143 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:51.819303 19890 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:51.820994 19964 raft_consensus.cc:740] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:51.822088 19698 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:51.878768 18445 raft_consensus.cc:1275] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:51.875339 18518 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:51.884492 18376 raft_consensus.cc:1275] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260204 08:59:51.886575 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 78224.1us
I20260204 08:59:51.859079 19819 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:51.857584 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:51.890688 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:51.861624 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:51.870800 19913 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 08:59:51.877105 19755 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:51.904938 18522 raft_consensus.cc:2368] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 5. Current term is 6.
W20260204 08:59:51.906754 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 79326.1us
I20260204 08:59:51.881524 19747 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:51.886258 19890 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:51.888044 19955 raft_consensus.cc:2749] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:51.915374 18343 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:51.916497 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:51.916949 19050 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:51.918932 19859 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:51.919333 19768 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:51.919700 18372 raft_consensus.cc:1240] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:51.920293 18370 raft_consensus.cc:1275] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:51.890021 19671 raft_consensus.cc:697] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:51.919294 19859 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:51.913030 19755 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:51.903405 19940 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:51.977687 18522 raft_consensus.cc:1240] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:51.980297 19100 raft_consensus.cc:1240] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:51.914431 19747 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:51.897590 19819 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:51.996475 18522 raft_consensus.cc:1275] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:51.908727 19791 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:51.979183 19859 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:52.002897 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 86008.9us
I20260204 08:59:51.988423 19698 raft_consensus.cc:697] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:52.013468 19050 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:52.024767 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:52.025116 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 109813us
I20260204 08:59:52.025969 18522 raft_consensus.cc:2393] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:51.998288 19660 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:52.021229 18519 raft_consensus.cc:1275] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:52.038576 19050 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:52.002298 19836 consensus_queue.cc:1059] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260204 08:59:52.026943 19745 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
W20260204 08:59:52.048451 19967 log.cc:927] Time spent T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.059s user 0.000s sys 0.001s
I20260204 08:59:52.057382 18369 raft_consensus.cc:1275] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260204 08:59:52.024837 19891 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:52.062280 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:52.179690 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 116724us
W20260204 08:59:52.180954 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 142465us
W20260204 08:59:52.215780 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 305268us
I20260204 08:59:52.216589 19050 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:52.043570 19700 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.046231 19938 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.045715 19913 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:51.988245 19964 consensus_queue.cc:260] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:52.059337 19738 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:52.036851 19660 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.264786 19983 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
W20260204 08:59:52.268213 19974 log.cc:927] Time spent T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.242s user 0.000s sys 0.000s
I20260204 08:59:52.269652 18520 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
W20260204 08:59:52.272444 19977 log.cc:927] Time spent T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.233s user 0.000s sys 0.000s
I20260204 08:59:52.274507 19835 raft_consensus.cc:3055] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:52.274247 19755 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.274899 19835 raft_consensus.cc:740] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:52.275785 19835 consensus_queue.cc:260] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.276929 19835 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:52.252300 19698 consensus_queue.cc:237] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:52.281627 19969 log.cc:927] Time spent T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.312s user 0.000s sys 0.000s
I20260204 08:59:52.283850 19940 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:52.284771 19979 log.cc:927] Time spent T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.236s user 0.002s sys 0.000s
I20260204 08:59:52.246033 19891 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:52.286989 19891 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:52.271409 19976 log.cc:927] Time spent T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.351s user 0.001s sys 0.000s
I20260204 08:59:52.235239 19745 raft_consensus.cc:697] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 08:59:52.289453 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:52.343194 19106 raft_consensus.cc:2368] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:52.289747 19951 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.277046 19660 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:52.242005 19700 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:52.350244 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 133742us
I20260204 08:59:52.350127 18522 raft_consensus.cc:1240] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 6. Ops: []
I20260204 08:59:52.216761 19671 consensus_queue.cc:237] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.283499 19747 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.291908 19957 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.375412 19050 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:52.262512 19738 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:52.403602 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:52.399448 19700 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:52.363900 19891 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.419065 18524 raft_consensus.cc:1275] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:52.421181 19738 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:52.429785 19950 log.cc:927] Time spent T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.701s user 0.010s sys 0.000s
I20260204 08:59:52.375214 19983 raft_consensus.cc:697] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:52.338979 19735 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:52.422042 19745 consensus_queue.cc:237] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.447106 18524 raft_consensus.cc:1275] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:52.419248 19791 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:52.435735 19781 consensus_meta.cc:287] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 1.163s user 0.013s sys 0.005s
W20260204 08:59:52.461885 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:52.463263 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:52.464568 18524 raft_consensus.cc:2393] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:52.473403 19747 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.480952 18518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52184 (request call id 279) took 1159 ms. Trace:
I20260204 08:59:52.481434 18518 rpcz_store.cc:276] 0204 08:59:51.321665 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:51.393671 (+ 72006us) service_pool.cc:225] Handling call
0204 08:59:52.480762 (+1087091us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54003dd954. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:52.480873 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":140551552}
I20260204 08:59:52.483665 19735 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:52.485761 19755 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:52.488221 19944 consensus_meta.cc:287] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.657s user 0.003s sys 0.007s
I20260204 08:59:52.488721 19944 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:52.490665 19944 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:52.436921 19891 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:52.491961 19996 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:52.496228 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:52.498963 18488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:52.500579 18488 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:52.495165 19859 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:52.506603 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 131270us
I20260204 08:59:52.506970 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:52.507807 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:52.509346 18376 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 08:59:52.510551 19050 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:52.517817 18525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 621) took 1253 ms. Trace:
I20260204 08:59:52.520073 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.520473 19993 raft_consensus.cc:2764] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260204 08:59:52.523593 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.518247 18525 rpcz_store.cc:276] 0204 08:59:51.259909 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:51.260311 (+ 402us) service_pool.cc:225] Handling call
0204 08:59:51.260603 (+ 292us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:51.281164 (+ 20561us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:51.281194 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:51.285875 (+ 4681us) log.cc:844] Serialized 26 byte log entry
0204 08:59:51.398519 (+112644us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:51.398606 (+ 87us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:51.399639 (+ 1033us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:52.429088 (+1029449us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 08:59:52.502467 (+ 73379us) raft_consensus.cc:1685] finished
0204 08:59:52.502490 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:52.512870 (+ 10380us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4527,"raft.queue_time_us":17745,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2796,"spinlock_wait_cycles":5778304,"thread_start_us":58227,"threads_started":1,"wal-append.queue_time_us":343339}
I20260204 08:59:52.524608 19050 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:52.528126 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.528937 19100 raft_consensus.cc:2393] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:52.513021 19660 raft_consensus.cc:2749] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:52.533963 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.534525 19107 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 08:59:52.512902 19735 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.535980 19794 consensus_queue.cc:1048] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:52.521782 19996 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:52.525527 19980 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.527593 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:52.515848 19700 consensus_queue.cc:1048] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260204 08:59:52.547497 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:52.548131 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:52.547490 18517 raft_consensus.cc:1275] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260204 08:59:52.549049 19890 consensus_meta.cc:287] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.618s user 0.007s sys 0.001s
W20260204 08:59:52.573459 19973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s user 0.004s sys 0.018s
W20260204 08:59:52.573890 19973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s user 0.004s sys 0.018s
I20260204 08:59:52.544283 19981 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.575824 18491 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:52.550577 19791 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.586018 19791 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.571470 19890 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:52.587608 19050 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:52.580601 19102 raft_consensus.cc:1275] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:52.581230 20002 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:52.582295 19995 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.588605 19791 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.596546 19995 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.598054 19890 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:52.598611 19995 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.600741 19747 consensus_queue.cc:1048] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:52.583467 19836 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 08:59:52.546541 19735 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:52.579404 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 45631.4us
I20260204 08:59:52.544142 19983 consensus_queue.cc:237] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.588821 19981 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.562963 19980 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.593950 19973 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.589329 19891 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:52.614920 19836 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:52.622675 18488 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:52.594767 18196 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54546 (request call id 124) took 6009 ms. Trace:
I20260204 08:59:52.594835 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:52.595194 19859 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:52.610931 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.617470 19105 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:52.606805 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.613477 19107 raft_consensus.cc:2468] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:52.606828 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.594578 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:52.618933 19913 raft_consensus.cc:697] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:52.629573 18376 raft_consensus.cc:2393] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:52.623950 18518 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:52.629772 18343 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:52.627954 18491 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:52.620366 19993 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:52.627707 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:52.620831 19995 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:52.631016 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:52.632709 19104 raft_consensus.cc:2410] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260204 08:59:52.625430 19836 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 08:59:52.629575 19671 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:52.631306 19993 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:52.642966 19993 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:52.638630 19981 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.622903 19973 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.650938 19646 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:52.652689 19735 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:52.653216 19101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46704 (request call id 763) took 1385 ms. Trace:
I20260204 08:59:52.653625 19101 rpcz_store.cc:276] 0204 08:59:51.250719 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:51.252776 (+ 2057us) service_pool.cc:225] Handling call
0204 08:59:51.548582 (+295806us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb530412e 000000000035a3c9 00007fcebd336560 00007fcebd3fedd4 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:52.547533 (+998951us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb53041cc 00007fceb5304136 000000000035a3c9 00007fcebd336560 00007fcebd3fedd4 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:52.547680 (+ 147us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:52.547882 (+ 202us) raft_consensus.cc:1534] Early marking committed up to index 2
0204 08:59:52.548155 (+ 273us) log.cc:844] Serialized 14 byte log entry
0204 08:59:52.622097 (+ 73942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:52.625309 (+ 3212us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:52.627775 (+ 2466us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:52.630950 (+ 3175us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:52.636220 (+ 5270us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":11826,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2251,"raft.queue_time_us":3636,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":5753,"spinlock_wait_cycles":10806272,"thread_start_us":58642,"threads_started":1,"wal-append.queue_time_us":91517}
I20260204 08:59:52.644539 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:52.633611 19660 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:52.656852 19660 raft_consensus.cc:697] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:52.657680 19660 consensus_queue.cc:237] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.622241 19747 consensus_queue.cc:1048] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260204 08:59:52.636000 19995 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:52.666342 18518 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:52.696560 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:52.694260 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 855053us
W20260204 08:59:52.697614 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 831766us
I20260204 08:59:52.679771 19099 raft_consensus.cc:2393] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:52.678656 19980 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:52.681969 19993 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.712613 19964 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:52.705350 18443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 658) took 1016 ms. Trace:
I20260204 08:59:52.637996 19913 consensus_queue.cc:237] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.714535 19993 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:52.673691 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 122261us
I20260204 08:59:52.701843 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.703955 19963 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:52.705331 19991 log.cc:927] Time spent T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.356s user 0.000s sys 0.002s
I20260204 08:59:52.636760 19891 raft_consensus.cc:2804] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:52.623750 18196 rpcz_store.cc:276] 0204 08:59:46.585137 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:46.585249 (+ 112us) service_pool.cc:225] Handling call
0204 08:59:47.944774 (+1359525us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54001c2ad4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83590c0 00007fceb83f7bba 00007fcebe180eac 00007fcebe27b10e 00007fcebc7764a4 00007fcebc776432 00007fcebc776361 00007fcebc7762dc 00007fcebc775592 00007fceb672e34c 00007fceb672d786
0204 08:59:52.594691 (+4649917us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 08:59:50.996166 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 08:59:51.024783 (+ 28617us) write_op.cc:432] Acquiring schema lock in shared mode
0204 08:59:51.024838 (+ 55us) write_op.cc:435] Acquired schema lock
0204 08:59:51.024855 (+ 17us) tablet.cc:660] Decoding operations
0204 08:59:51.025461 (+ 606us) write_op.cc:620] Acquiring the partition lock for write op
0204 08:59:51.025552 (+ 91us) write_op.cc:641] Partition lock acquired for write op
0204 08:59:51.025578 (+ 26us) tablet.cc:683] Acquiring locks for 3 operations
0204 08:59:51.025999 (+ 421us) tablet.cc:699] Row locks acquired
0204 08:59:51.026018 (+ 19us) write_op.cc:260] PREPARE: finished
0204 08:59:51.026160 (+ 142us) write_op.cc:270] Start()
0204 08:59:51.026313 (+ 153us) write_op.cc:276] Timestamp: P: 1770195591026107 usec, L: 0
0204 08:59:51.026358 (+ 45us) op_driver.cc:348] REPLICATION: starting
0204 08:59:51.059166 (+ 32808us) log.cc:844] Serialized 1307 byte log entry
0204 08:59:51.288660 (+229494us) op_driver.cc:464] REPLICATION: finished
0204 08:59:51.587155 (+298495us) write_op.cc:301] APPLY: starting
0204 08:59:51.604134 (+ 16979us) tablet.cc:1365] starting BulkCheckPresence
0204 08:59:51.612619 (+ 8485us) tablet.cc:1368] finished BulkCheckPresence
0204 08:59:51.612759 (+ 140us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 08:59:51.634315 (+ 21556us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 08:59:51.634586 (+ 271us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0204 08:59:51.646948 (+ 12362us) write_op.cc:312] APPLY: finished
0204 08:59:51.679709 (+ 32761us) log.cc:844] Serialized 34 byte log entry
0204 08:59:51.679935 (+ 226us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:51.680026 (+ 91us) write_op.cc:454] Released schema lock
0204 08:59:51.680079 (+ 53us) write_op.cc:341] FINISH: Updating metrics
0204 08:59:51.680485 (+ 406us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:51.680518 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"spinlock_wait_cycles":1943966080,"child_traces":[["op",{"apply.queue_time_us":238700,"apply.run_cpu_time_us":3096,"apply.run_wall_time_us":141481,"num_ops":3,"prepare.queue_time_us":179633,"prepare.run_cpu_time_us":3783,"prepare.run_wall_time_us":98608,"replication_time_us":236102,"thread_start_us":79882,"threads_started":2}]]}
I20260204 08:59:52.686077 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.676927 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.681051 19973 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.678764 19995 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:52.738564 19108 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 08:59:52.739545 18343 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:52.740985 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:52.742419 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:52.742787 18450 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:52.743382 18447 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:52.744285 18340 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:52.747722 19671 consensus_queue.cc:1048] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:52.749420 19980 consensus_queue.cc:1048] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:52.750245 19985 consensus_queue.cc:1048] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260204 08:59:52.750957 19891 raft_consensus.cc:697] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:52.752172 19959 consensus_queue.cc:1048] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260204 08:59:52.743005 18414 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:52.757995 18488 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:52.758739 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:52.754204 19101 raft_consensus.cc:2393] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:52.761198 19108 raft_consensus.cc:2368] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4.
I20260204 08:59:52.739475 19949 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:52.771713 19644 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:52.771968 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.772594 19107 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:52.772743 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:52.773216 19764 consensus_queue.cc:1048] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260204 08:59:52.776371 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:52.777408 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.778038 19105 raft_consensus.cc:2368] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:52.741394 19102 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:52.781569 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:52.779400 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:52.784636 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.788321 18451 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 5
I20260204 08:59:52.784273 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.754519 19642 consensus_queue.cc:1048] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260204 08:59:52.752221 20003 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:52.764384 19980 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.790923 19108 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:52.792815 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.794265 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:52.789525 19050 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:52.792690 18491 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:52.800072 18376 raft_consensus.cc:1275] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:52.776026 19940 raft_consensus.cc:2749] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:52.776156 19821 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.805097 19107 raft_consensus.cc:1275] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:52.806306 18343 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:52.808055 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:52.786463 19981 raft_consensus.cc:2749] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:52.789314 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:52.832902 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:52.833557 18448 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:52.794178 19987 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:52.835247 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:52.797520 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:52.797376 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:52.846772 18444 raft_consensus.cc:2393] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:52.840801 18447 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:52.804288 19819 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:52.845255 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:52.790202 19949 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:52.853207 18377 raft_consensus.cc:2368] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4.
I20260204 08:59:52.855191 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:52.832284 19893 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:52.838771 18520 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:52.865588 19700 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.866101 19700 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.868028 19700 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.714635 18443 rpcz_store.cc:276] 0204 08:59:51.689175 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:51.689709 (+ 534us) service_pool.cc:225] Handling call
0204 08:59:51.706615 (+ 16906us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:51.706817 (+ 202us) raft_consensus.cc:1534] Early marking committed up to index 4
0204 08:59:51.817639 (+110822us) log.cc:844] Serialized 14 byte log entry
0204 08:59:52.484922 (+667283us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b1800126a00. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fcebe19dc91 00007fcebe1aa671 00007fceb53412d3 00007fceb53436a1 00007fceb5343659 00007fceb53435e9 00007fceb53435b1 00007fceb53428ad 0000000000379254 0000000000379099 00007fceb532469a
0204 08:59:52.694521 (+209599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:52.697165 (+ 2644us) raft_consensus.cc:1645] Marking committed up to 4
0204 08:59:52.698109 (+ 944us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:52.705173 (+ 7064us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:52.705295 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":860291,"prepare.queue_time_us":85203,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":869510,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9088,"spinlock_wait_cycles":7801088,"thread_start_us":86027,"threads_started":1}
I20260204 08:59:52.868515 19898 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:52.869064 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.798763 19891 consensus_queue.cc:237] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:52.859452 18516 raft_consensus.cc:1275] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:52.860471 19949 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:52.860872 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:52.861742 19966 log.cc:927] Time spent T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.888s user 0.012s sys 0.000s
I20260204 08:59:52.853248 19835 raft_consensus.cc:2749] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:52.848575 20003 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:52.804646 19980 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:52.880905 19971 log.cc:927] Time spent T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.538s user 0.001s sys 0.001s
I20260204 08:59:52.881232 19951 consensus_queue.cc:1048] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:52.884495 19893 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:52.876381 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.888792 18450 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:52.851567 19944 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:52.894817 18417 leader_election.cc:400] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:52.832008 19649 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.924335 18417 leader_election.cc:403] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260204 08:59:52.925141 18417 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:52.926035 18417 leader_election.cc:400] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4.
I20260204 08:59:52.926275 18417 leader_election.cc:403] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260204 08:59:52.863230 19836 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.927660 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.858256 19940 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.896299 18414 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:52.809499 19821 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.916186 19105 raft_consensus.cc:1275] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:52.898623 18442 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:52.941591 18447 raft_consensus.cc:2393] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:52.929234 20019 consensus_queue.cc:1048] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
W20260204 08:59:52.931357 20027 log.cc:927] Time spent T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
I20260204 08:59:52.897974 20003 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:52.940121 19747 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.940261 19980 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:52.940665 19821 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:52.950537 19747 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:52.952489 19747 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:52.897715 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.944550 18444 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:52.941653 18451 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:52.954568 19970 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:52.954811 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:52.955019 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:52.946468 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 50275.1us
I20260204 08:59:52.957139 18414 leader_election.cc:400] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4.
I20260204 08:59:52.934288 19649 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:52.957937 18520 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:52.959057 19649 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:52.960059 19993 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:52.960548 19993 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:52.960700 19821 consensus_queue.cc:1048] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:52.962108 19893 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:52.962327 19993 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:52.947878 19952 consensus_queue.cc:1048] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260204 08:59:52.962893 18443 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 08:59:52.941826 19940 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:52.964020 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:52.964617 18524 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:52.965546 19940 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:52.967993 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:52.968755 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 179317us
I20260204 08:59:52.947206 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.948045 20003 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:52.955616 18369 raft_consensus.cc:2393] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 3: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:52.973019 18450 raft_consensus.cc:2393] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:52.979382 19050 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:52.964617 18414 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:52.982475 18448 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:52.983309 18451 raft_consensus.cc:1275] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:52.968945 19631 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:52.951176 19836 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:52.989624 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:52.990245 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:52.991010 18442 raft_consensus.cc:2393] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:52.991778 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.992221 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:52.992851 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.993978 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.994715 18442 raft_consensus.cc:2410] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260204 08:59:52.996991 19987 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:52.989655 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:52.997452 19987 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:52.947598 19646 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:52.999258 19646 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:52.999699 19646 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:52.986322 19898 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:52.984756 19781 consensus_queue.cc:1048] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260204 08:59:52.999260 18450 raft_consensus.cc:1275] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260204 08:59:53.009393 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 44847.9us
I20260204 08:59:52.997013 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:53.010824 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:53.011394 18414 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:52.978878 19750 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:53.012146 19940 consensus_queue.cc:1048] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:53.012148 19893 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:53.014302 19898 raft_consensus.cc:697] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:53.015269 19898 consensus_queue.cc:237] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.016301 19859 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:53.016810 19859 raft_consensus.cc:697] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:53.017649 19859 consensus_queue.cc:237] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:52.946609 19873 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4.
I20260204 08:59:53.010264 19100 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:53.020082 19050 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:53.022163 18414 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:53.022691 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 232723us
I20260204 08:59:52.941673 19944 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:53.028455 18488 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.031247 19913 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:53.024995 19750 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:53.070030 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:53.040728 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:53.104647 18447 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:53.012590 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.067739 19106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46718 (request call id 646) took 1275 ms. Trace:
I20260204 08:59:53.080545 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:53.059231 19987 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:53.108533 19913 raft_consensus.cc:697] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:53.109563 19913 consensus_queue.cc:237] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.109948 19987 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:53.106614 19106 rpcz_store.cc:276] 0204 08:59:51.788309 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:51.789515 (+ 1206us) service_pool.cc:225] Handling call
0204 08:59:53.063312 (+1273797us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400009bd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:53.063468 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1216600832}
I20260204 08:59:53.113916 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.029951 18417 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:53.053987 20003 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:53.117794 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 87938.2us
I20260204 08:59:53.118757 18417 leader_election.cc:400] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:53.119055 18417 leader_election.cc:403] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260204 08:59:53.089259 20019 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:53.030529 19952 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:53.086216 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.046176 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:53.117300 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:53.062732 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:53.140367 18449 raft_consensus.cc:2376] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5. Re-sending same reply.
I20260204 08:59:53.043462 18340 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:53.141444 19984 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260204 08:59:53.141485 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 98118us
I20260204 08:59:53.141888 19984 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:53.142349 19984 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:53.142642 18340 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.144398 19988 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:53.121258 19873 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:53.156500 19873 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:53.156879 19873 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:53.075755 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:53.114560 18377 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:53.116109 19750 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:53.159986 19099 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:53.160598 19050 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.050009 18448 raft_consensus.cc:2393] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:53.128643 19962 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5.
I20260204 08:59:53.130493 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.162582 18417 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:53.162803 18449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39114 (request call id 331) took 1328 ms. Trace:
W20260204 08:59:53.131302 19982 log.cc:927] Time spent T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.713s user 0.001s sys 0.002s
I20260204 08:59:53.132027 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:53.091601 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.153394 20004 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:53.154366 19944 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:53.154816 19958 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:53.156001 19104 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:53.121048 19814 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:53.164755 18340 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.170987 19750 raft_consensus.cc:2749] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260204 08:59:53.087754 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 59375.5us
I20260204 08:59:53.163136 18449 rpcz_store.cc:276] 0204 08:59:51.812593 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:51.814777 (+ 2184us) service_pool.cc:225] Handling call
0204 08:59:53.062559 (+1247782us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:53.140800 (+ 78241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7224064}
I20260204 08:59:53.166826 19109 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 08:59:53.176479 19050 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.146248 19101 raft_consensus.cc:1275] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:53.189451 18417 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:53.185782 18340 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:53.191855 18340 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 08:59:53.167769 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:53.171262 19781 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:53.182040 18373 raft_consensus.cc:1240] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:53.188814 18488 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.201851 18488 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.151537 19984 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:53.202844 20019 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:53.204523 18488 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:53.206002 20019 raft_consensus.cc:2804] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:53.206341 20019 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:53.206691 20019 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:53.183259 20004 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.189435 19644 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:53.212391 19944 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:53.212893 19944 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:53.213438 20004 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:53.214684 19944 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:53.187050 19958 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.217159 19958 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:53.217265 19890 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:53.217708 19890 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:53.218052 19890 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:53.218353 20019 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.220857 19646 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.221745 20030 consensus_queue.cc:1048] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:53.222718 19646 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:53.228770 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.206532 18197 catalog_manager.cc:5654] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 3 to 4, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 4 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:53.230588 18197 catalog_manager.cc:5654] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 5 to 6, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 6 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:53.232560 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:53.233975 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:53.193974 19764 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:53.193753 19781 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:53.253547 19781 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:53.242067 19631 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:53.255880 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:53.252079 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:53.257074 19107 raft_consensus.cc:2393] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:53.257869 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:53.233600 19940 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:53.253116 19764 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:53.255985 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.259195 19631 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:53.252801 19099 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:53.251696 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:53.260731 19873 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:53.261942 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:53.263918 19764 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:53.197630 19998 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:53.257887 18340 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.258877 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:53.259572 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.220899 19984 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:53.287192 19099 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:53.221390 20019 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:53.269796 19107 raft_consensus.cc:1275] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:53.271994 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:53.287516 18447 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:53.191320 19814 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:53.224169 19962 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 08:59:53.277087 18371 raft_consensus.cc:1275] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:53.297907 19962 raft_consensus.cc:697] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:53.298758 19814 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:53.272691 18414 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:53.294397 18417 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:53.266695 18197 catalog_manager.cc:5654] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 3 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } }
I20260204 08:59:53.301272 18340 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:53.230428 19660 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:53.296658 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:53.315389 18372 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 08:59:53.298934 19962 consensus_queue.cc:237] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:53.313678 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:53.313891 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:53.319393 18197 catalog_manager.cc:5654] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 3 to 4, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 4 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } }
I20260204 08:59:53.326336 18197 catalog_manager.cc:5654] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:53.299863 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:53.310417 19955 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:53.334895 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:53.316772 19952 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:53.316706 19644 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:53.334419 18525 raft_consensus.cc:1275] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 08:59:53.310055 19984 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:53.326324 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:53.333890 18197 catalog_manager.cc:5654] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 3 to 5, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 5 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.335071 18414 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:53.372778 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:53.381523 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:53.382236 18197 catalog_manager.cc:5654] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 2, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 2 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.383891 18197 catalog_manager.cc:5654] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.385771 18197 catalog_manager.cc:5654] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.339885 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:53.397428 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 62428us
I20260204 08:59:53.410326 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:53.412340 18518 raft_consensus.cc:2410] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260204 08:59:53.325139 19993 consensus_queue.cc:1048] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260204 08:59:53.397356 18340 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:53.413964 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:53.409482 18491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s user 0.018s sys 0.021s
I20260204 08:59:53.368827 19891 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:53.372826 19952 raft_consensus.cc:697] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:53.453689 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:53.455699 18376 raft_consensus.cc:1275] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:53.377140 20003 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:53.462433 18372 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 7.
I20260204 08:59:53.465051 19660 consensus_queue.cc:1048] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:53.412700 18197 catalog_manager.cc:5654] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } }
I20260204 08:59:53.348887 19964 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:53.467512 19964 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:53.431869 18491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s user 0.018s sys 0.021s
W20260204 08:59:53.469300 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 676643us
I20260204 08:59:53.373472 19644 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:53.471495 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:53.472074 19107 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:53.474226 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:53.475191 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:53.475756 19106 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 08:59:53.475904 19988 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:53.477190 19940 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:53.477646 19940 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:53.484087 19107 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 08:59:53.485678 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:53.485735 18417 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:53.448611 19958 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:53.489648 18371 raft_consensus.cc:1275] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260204 08:59:53.494005 18371 pending_rounds.cc:85] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Aborting all ops after (but not including) 2
I20260204 08:59:53.494414 18371 pending_rounds.cc:107] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260204 08:59:53.494045 19958 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:53.414629 19995 consensus_queue.cc:1048] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260204 08:59:53.494676 18371 raft_consensus.cc:2889] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:53.494966 19104 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:53.490855 19644 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:53.461251 19891 raft_consensus.cc:697] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:53.496119 19873 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:53.496444 19891 consensus_queue.cc:237] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:53.496858 19890 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:53.500131 18488 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:53.491608 19952 consensus_queue.cc:237] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.493547 18369 raft_consensus.cc:1275] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:53.477397 19973 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:53.502923 18444 raft_consensus.cc:1275] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:53.506956 19107 raft_consensus.cc:1240] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:53.501011 19106 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 7.
I20260204 08:59:53.512837 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:53.513480 19109 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 08:59:53.517427 18525 raft_consensus.cc:1240] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:53.505759 18197 catalog_manager.cc:5654] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 2 to 4, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 4 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.522348 18197 catalog_manager.cc:5654] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.502974 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:53.510262 19873 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:53.512885 19890 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:53.508701 19983 consensus_queue.cc:1048] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260204 08:59:53.571103 18197 catalog_manager.cc:5654] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 2 to 3, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 3 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.545029 19631 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:53.595520 18197 catalog_manager.cc:5654] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.632934 18518 raft_consensus.cc:1275] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260204 08:59:53.633445 18518 pending_rounds.cc:85] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4: Aborting all ops after (but not including) 2
I20260204 08:59:53.554090 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:53.633728 18518 pending_rounds.cc:107] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260204 08:59:53.635931 18518 raft_consensus.cc:2889] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 08:59:53.637418 18197 catalog_manager.cc:5654] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 reported cstate change: term changed from 3 to 5, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 5 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:53.564967 20019 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:53.567382 19964 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:53.595273 19940 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:53.677850 18521 raft_consensus.cc:1275] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:53.634038 19873 raft_consensus.cc:697] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 6 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:53.657007 19814 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election won for term 7
I20260204 08:59:53.680819 18518 raft_consensus.cc:1275] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:53.596043 19764 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:53.659601 20019 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.689702 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:53.694499 20042 log.cc:927] Time spent T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.054s user 0.000s sys 0.001s
W20260204 08:59:53.696496 20041 log.cc:927] Time spent T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.159s user 0.000s sys 0.000s
I20260204 08:59:53.687918 19814 raft_consensus.cc:697] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:53.577876 19781 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.700461 18368 raft_consensus.cc:1240] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
W20260204 08:59:53.707818 20039 log.cc:927] Time spent T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.135s user 0.000s sys 0.001s
I20260204 08:59:53.723186 18519 raft_consensus.cc:1275] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:53.720461 19890 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:53.728595 18521 raft_consensus.cc:1275] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:53.699262 19958 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:53.731791 19873 consensus_queue.cc:237] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:53.732793 20019 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:53.733438 20019 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:53.733855 20019 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:53.735951 19814 consensus_queue.cc:237] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:53.737180 19764 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:53.730183 19940 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:53.735553 20019 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:53.767867 18451 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
W20260204 08:59:53.760190 19913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s user 0.005s sys 0.024s
I20260204 08:59:53.731791 19890 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:53.769378 19913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s user 0.005s sys 0.024s
W20260204 08:59:53.793171 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 395865us
I20260204 08:59:53.819624 18445 raft_consensus.cc:1275] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:53.829660 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:53.848582 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 347157us
W20260204 08:59:53.898310 18524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s user 0.024s sys 0.005s
W20260204 08:59:53.898766 18524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s user 0.024s sys 0.005s
W20260204 08:59:53.901603 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 50310us
I20260204 08:59:53.902822 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:53.903398 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 491244us
I20260204 08:59:53.904122 18414 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:53.928529 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:53.958746 18340 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:53.959784 19745 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 08:59:53.961833 19745 consensus_queue.cc:1048] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:53.965065 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:53.981371 18343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s user 0.020s sys 0.037s
W20260204 08:59:53.903947 20047 log.cc:927] Time spent T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.123s user 0.000s sys 0.001s
W20260204 08:59:54.070716 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 166670us
W20260204 08:59:54.072181 18343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s user 0.020s sys 0.037s
W20260204 08:59:54.069977 18488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s user 0.000s sys 0.036s
W20260204 08:59:54.104180 18488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s user 0.000s sys 0.036s
W20260204 08:59:54.104545 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 604444us
I20260204 08:59:54.109009 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:54.110427 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:54.110818 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:54.111102 18521 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
W20260204 08:59:54.114763 18341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s user 0.021s sys 0.040s
W20260204 08:59:54.115137 18341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s user 0.021s sys 0.040s
W20260204 08:59:54.117892 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 152637us
I20260204 08:59:54.119076 18340 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:54.120100 18414 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:54.125622 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:54.115159 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
W20260204 08:59:54.132092 18447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s user 0.019s sys 0.022s
W20260204 08:59:54.132472 18447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s user 0.019s sys 0.022s
I20260204 08:59:54.132288 18377 raft_consensus.cc:1240] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:54.137192 19100 raft_consensus.cc:1275] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 08:59:54.072970 19984 raft_consensus.cc:2749] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:53.980909 19962 consensus_queue.cc:1048] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.150s
I20260204 08:59:54.131640 20009 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:54.155330 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:54.155158 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 427171us
I20260204 08:59:54.161140 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:54.160188 18374 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:54.167155 18491 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:54.147228 19781 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:54.167515 18442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s user 0.007s sys 0.034s
I20260204 08:59:54.136251 20002 consensus_queue.cc:1048] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260204 08:59:54.159150 20030 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s user 0.013s sys 0.034s
I20260204 08:59:54.167194 19913 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 08:59:54.192652 18489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s user 0.003s sys 0.028s
W20260204 08:59:54.193009 18489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s user 0.003s sys 0.028s
I20260204 08:59:54.193559 20059 raft_consensus.cc:2749] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 08:59:54.196617 20065 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:54.197131 20065 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:54.198969 20056 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:54.200241 19913 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:54.202292 19913 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:54.171391 19890 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:54.176944 18442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s user 0.007s sys 0.034s
I20260204 08:59:54.188287 19952 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260204 08:59:54.191915 20030 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s user 0.013s sys 0.035s
I20260204 08:59:54.169919 20009 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:54.198988 20065 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:54.214322 18443 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s user 0.010s sys 0.010s
I20260204 08:59:54.225726 19965 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260204 08:59:54.230245 18443 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s user 0.010s sys 0.011s
I20260204 08:59:54.242551 18442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 949) took 1394 ms. Trace:
I20260204 08:59:54.256393 20002 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:54.266294 20002 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:54.268440 20002 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:54.258699 18442 rpcz_store.cc:276] 0204 08:59:52.844143 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:52.995185 (+151042us) service_pool.cc:225] Handling call
0204 08:59:52.995498 (+ 313us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:53.044011 (+ 48513us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:53.044052 (+ 41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:53.044545 (+ 493us) log.cc:844] Serialized 26 byte log entry
0204 08:59:53.344605 (+300060us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:53.467214 (+122609us) log.cc:844] Serialized 14 byte log entry
0204 08:59:54.216778 (+749564us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:54.226325 (+ 9547us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:54.227416 (+ 1091us) raft_consensus.cc:1685] finished
0204 08:59:54.228825 (+ 1409us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:54.238956 (+ 10131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22687,"prepare.queue_time_us":91623,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":47207,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":1769,"thread_start_us":1013382,"threads_started":2,"wal-append.queue_time_us":444250}
I20260204 08:59:54.275411 20069 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:54.275913 20069 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:54.276273 20069 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:54.282485 20009 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:54.249192 18446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s user 0.014s sys 0.020s
W20260204 08:59:54.292713 18446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s user 0.014s sys 0.020s
I20260204 08:59:54.291697 18443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 954) took 1052 ms. Trace:
W20260204 08:59:54.300922 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 180908us
W20260204 08:59:54.305239 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 186216us
I20260204 08:59:54.306082 18340 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:54.300246 19814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s user 0.003s sys 0.017s
I20260204 08:59:54.328117 18343 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:54.323103 19814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s user 0.003s sys 0.017s
I20260204 08:59:54.330457 19649 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:54.345136 19649 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:54.347118 19649 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:54.349262 20056 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:54.349843 20056 raft_consensus.cc:697] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:54.350682 20056 consensus_queue.cc:237] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:54.429774 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 91826.8us
I20260204 08:59:54.326705 19642 consensus_queue.cc:1048] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260204 08:59:54.304543 19951 consensus_queue.cc:1059] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260204 08:59:54.323390 20055 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 08:59:54.363294 20061 log.cc:927] Time spent T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.123s user 0.000s sys 0.001s
W20260204 08:59:54.436401 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 265505us
I20260204 08:59:54.447301 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:54.453214 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 286151us
I20260204 08:59:54.443358 18488 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:54.442267 19951 consensus_queue.cc:1243] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer 44601d9bf1ce4a70a5b01dcfc505d276 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260204 08:59:54.468267 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:54.469991 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:54.470631 18451 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:54.473177 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:54.475354 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:54.456573 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:54.449147 19814 consensus_queue.cc:1059] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260204 08:59:54.491619 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:54.494841 19105 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:54.492646 20006 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:54.493330 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 667) took 1178 ms. Trace:
I20260204 08:59:54.510321 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:54.523351 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 55469.8us
I20260204 08:59:54.524327 18491 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:54.489616 18520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 674) took 1145 ms. Trace:
I20260204 08:59:54.525453 18520 rpcz_store.cc:276] 0204 08:59:53.344205 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.344860 (+ 655us) service_pool.cc:225] Handling call
0204 08:59:53.371790 (+ 26930us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:53.451400 (+ 79610us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:53.457638 (+ 6238us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:53.503265 (+ 45627us) log.cc:844] Serialized 26 byte log entry
0204 08:59:53.945194 (+441929us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:54.440771 (+495577us) log.cc:844] Serialized 14 byte log entry
0204 08:59:54.461447 (+ 20676us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:54.469313 (+ 7866us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:54.471475 (+ 2162us) raft_consensus.cc:1685] finished
0204 08:59:54.474689 (+ 3214us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:54.482355 (+ 7666us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52943,"prepare.queue_time_us":201165,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":31636,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":19136,"thread_start_us":750380,"threads_started":2,"wal-append.queue_time_us":685634}
W20260204 08:59:54.528209 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 202888us
I20260204 08:59:54.454731 20055 consensus_queue.cc:1048] T b53e40eb77df4f698c18c0d12effd872 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260204 08:59:54.534163 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 204053us
I20260204 08:59:54.549703 20078 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:54.550079 20077 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:54.550580 20078 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:54.550696 20077 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:54.552863 20077 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:54.498557 18523 rpcz_store.cc:276] 0204 08:59:53.314580 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.314679 (+ 99us) service_pool.cc:225] Handling call
0204 08:59:53.328732 (+ 14053us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:53.342693 (+ 13961us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:53.342725 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:53.413222 (+ 70497us) log.cc:844] Serialized 26 byte log entry
0204 08:59:53.898112 (+484890us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:53.979771 (+ 81659us) log.cc:844] Serialized 14 byte log entry
0204 08:59:53.998865 (+ 19094us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:53.998948 (+ 83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:54.493023 (+494075us) raft_consensus.cc:1685] finished
0204 08:59:54.493043 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:54.493185 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":174027,"prepare.queue_time_us":97420,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":230198,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":51355,"thread_start_us":408835,"threads_started":1,"wal-append.queue_time_us":787264}
I20260204 08:59:54.554388 20079 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:54.554872 20079 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:54.556141 18451 raft_consensus.cc:1240] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:54.556720 20079 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:54.557183 20079 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:54.557600 20079 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:54.559341 20079 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:54.539366 19951 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:54.545799 18490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s user 0.000s sys 0.054s
W20260204 08:59:54.560154 18490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s user 0.000s sys 0.054s
I20260204 08:59:54.560112 19951 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:54.561077 20052 log.cc:927] Time spent T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260204 08:59:54.562150 19951 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:54.563550 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 101455us
I20260204 08:59:54.538561 20002 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:54.616539 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 155863us
I20260204 08:59:54.585561 18340 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:54.600988 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:54.620831 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:54.620870 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:54.621403 19107 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:54.621599 18376 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:54.497988 20068 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260204 08:59:54.628116 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 147964us
I20260204 08:59:54.626813 19105 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:54.552794 20078 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:54.564321 20086 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:54.656152 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:54.658114 18376 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 08:59:54.570350 19890 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:54.599570 20059 raft_consensus.cc:3055] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Stepping down as leader of term 5
W20260204 08:59:54.659068 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 134835us
I20260204 08:59:54.568892 20083 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:54.528815 20006 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:54.675050 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:54.670961 18491 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:54.299016 18443 rpcz_store.cc:276] 0204 08:59:53.235883 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.246112 (+ 10229us) service_pool.cc:225] Handling call
0204 08:59:53.287991 (+ 41879us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:53.288335 (+ 344us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:53.288370 (+ 35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:53.288824 (+ 454us) log.cc:844] Serialized 26 byte log entry
0204 08:59:53.533472 (+244648us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:54.254170 (+720698us) log.cc:844] Serialized 14 byte log entry
0204 08:59:54.260735 (+ 6565us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:54.264487 (+ 3752us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:54.265966 (+ 1479us) raft_consensus.cc:1685] finished
0204 08:59:54.265984 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:54.288626 (+ 22642us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":37859,"raft.queue_time_us":5604,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":3659,"spinlock_wait_cycles":4414848,"thread_start_us":876148,"threads_started":2,"wal-append.queue_time_us":478087}
I20260204 08:59:54.676522 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:54.628355 20068 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:54.622287 20088 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:54.688906 19105 raft_consensus.cc:1275] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:54.549559 19940 consensus_queue.cc:1048] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260204 08:59:54.585700 19973 consensus_queue.cc:1059] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260204 08:59:54.709628 18372 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:54.656101 20085 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:54.669382 20059 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:54.674423 20086 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:54.696801 20083 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:54.685113 19890 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:54.645818 20002 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:54.726166 18370 raft_consensus.cc:1275] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 08:59:54.718684 19107 raft_consensus.cc:1275] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 08:59:54.685865 20068 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:54.691267 20096 raft_consensus.cc:2749] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:54.717962 19987 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:54.746920 20002 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:54.753165 19890 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:54.755146 20083 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:54.756899 19987 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:54.769212 19987 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:54.730417 19913 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:54.757112 20098 raft_consensus.cc:3055] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:54.691072 20088 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:54.756481 19980 consensus_queue.cc:1059] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260204 08:59:54.798128 19633 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:54.785593 20083 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:54.780570 20077 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:54.803977 19814 consensus_queue.cc:1059] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260204 08:59:54.804141 19633 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:54.778440 19913 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:54.791438 20097 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:54.799801 19962 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:54.787985 19970 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:54.789726 20098 raft_consensus.cc:740] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:54.798729 20105 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 08:59:54.729367 20085 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:54.778968 20059 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:54.829962 20083 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:54.830634 20077 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:54.867558 19633 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:54.857501 20006 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:54.839354 19962 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:54.870936 20059 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:54.887758 20085 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:54.889171 20088 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:54.870357 20100 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:54.844213 19970 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:54.879528 20086 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:54.839906 20097 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:54.902166 20069 consensus_meta.cc:287] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.625s user 0.001s sys 0.010s
I20260204 08:59:54.871734 20098 consensus_queue.cc:260] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:54.900044 20100 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:54.936620 20093 log.cc:927] Time spent T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.099s user 0.000s sys 0.000s
I20260204 08:59:54.919684 20069 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:55.003608 20083 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:55.005229 20098 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
W20260204 08:59:55.005679 20109 log.cc:927] Time spent T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.087s user 0.000s sys 0.001s
I20260204 08:59:55.005276 20068 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:55.007027 20077 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:55.007612 20068 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:55.010284 20097 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:55.010502 20069 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:55.009861 20100 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:55.824942 18342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.164s user 0.004s sys 0.022s
W20260204 08:59:55.825608 18342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s user 0.005s sys 0.023s
I20260204 08:59:55.868992 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 08:59:55.912714 20056 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:55.913367 20056 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:56.011334 18231 debug-util.cc:398] Leaking SignalData structure 0x7b0800338840 after lost signal to thread 15378
W20260204 08:59:56.011945 18231 debug-util.cc:398] Leaking SignalData structure 0x7b08002c56c0 after lost signal to thread 15380
I20260204 08:59:56.067920 20125 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:56.068759 20125 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.071081 20125 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.084606 20125 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.264324 20125 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.131489 20126 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:56.265470 20126 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.267714 20126 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:55.915402 20056 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.268513 20056 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:56.269028 20056 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:56.108419 18197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s user 0.006s sys 0.000s
W20260204 08:59:56.269865 18197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.686s user 0.006s sys 0.000s
I20260204 08:59:56.302184 20056 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.315693 20125 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 08:59:56.350294 20059 consensus_meta.cc:287] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 1.458s user 0.024s sys 0.000s
W20260204 08:59:56.376884 19050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.730s user 0.007s sys 0.033s
W20260204 08:59:56.377571 19050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.749s user 0.008s sys 0.034s
I20260204 08:59:56.378433 20126 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.378986 20126 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.380968 20126 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:56.381443 20126 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.381896 20126 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:56.383267 18490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.778s user 0.001s sys 0.029s
W20260204 08:59:56.383638 18490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.778s user 0.001s sys 0.029s
I20260204 08:59:56.383967 19050 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 08:59:56.437079 18489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.820s user 0.014s sys 0.047s
W20260204 08:59:56.437670 18489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.832s user 0.015s sys 0.047s
I20260204 08:59:56.448058 20125 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:56.448597 20125 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:56.448940 20125 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
W20260204 08:59:56.522785 19987 consensus_meta.cc:287] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 1.753s user 0.004s sys 0.015s
I20260204 08:59:56.549501 20098 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:56.610186 20128 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:56.638036 20126 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.676162 19962 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.687489 20129 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:56.721215 20102 raft_consensus.cc:3055] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:56.773972 20130 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:56.902676 20130 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.905004 20130 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:56.783529 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 255) took 2318 ms. Trace:
I20260204 08:59:56.907471 18377 rpcz_store.cc:276] 0204 08:59:54.465435 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.465584 (+ 149us) service_pool.cc:225] Handling call
0204 08:59:54.465917 (+ 333us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 08:59:54.468616 (+ 2699us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:54.468648 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 08:59:54.475722 (+ 7074us) log.cc:844] Serialized 52 byte log entry
0204 08:59:54.591186 (+115464us) raft_consensus.cc:1645] Marking committed up to 1
0204 08:59:54.591230 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:54.591298 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:56.783138 (+2191840us) raft_consensus.cc:1685] finished
0204 08:59:56.783161 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:56.783427 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5131,"raft.queue_time_us":73856,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":26873,"thread_start_us":96927,"threads_started":1,"wal-append.queue_time_us":311063,"wal-append.run_cpu_time_us":1641,"wal-append.run_wall_time_us":1001664}
I20260204 08:59:56.730978 19970 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.901827 20134 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.912835 20134 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.811329 20131 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:56.913906 20131 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:56.916119 20131 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.805289 20125 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.918735 20125 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:56.733568 19109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46718 (request call id 671) took 2255 ms. Trace:
I20260204 08:59:56.919268 19109 rpcz_store.cc:276] 0204 08:59:54.477881 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.478054 (+ 173us) service_pool.cc:225] Handling call
0204 08:59:54.492309 (+ 14255us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:54.605562 (+113253us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:54.605591 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:54.624378 (+ 18787us) log.cc:844] Serialized 26 byte log entry
0204 08:59:54.854607 (+230229us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:54.854648 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:54.855255 (+ 607us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:56.733270 (+1878015us) raft_consensus.cc:1685] finished
0204 08:59:56.733295 (+ 25us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:56.733469 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20249,"raft.queue_time_us":177775,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12262,"thread_start_us":332858,"threads_started":2,"wal-append.queue_time_us":278537,"wal-append.run_cpu_time_us":2319,"wal-append.run_wall_time_us":1103700}
I20260204 08:59:56.834779 20132 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:56.922441 20132 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:56.924499 20132 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.883878 20098 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:56.873137 19050 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.3.196:33765 timed out after 1.800s (SENT) [suppressed 1 similar messages]
I20260204 08:59:56.932013 20098 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:56.884020 20128 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:56.833602 20053 log.cc:927] Time spent T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 2.662s user 0.007s sys 0.015s
I20260204 08:59:56.934093 20128 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.884323 20126 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.934814 20126 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.936152 18375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 750) took 3697 ms. Trace:
I20260204 08:59:56.934918 20134 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:56.936743 20126 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.936518 18375 rpcz_store.cc:276] 0204 08:59:53.238538 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.240981 (+ 2443us) service_pool.cc:225] Handling call
0204 08:59:53.295183 (+ 54202us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:53.325595 (+ 30412us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:53.325625 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:53.339908 (+ 14283us) log.cc:844] Serialized 26 byte log entry
0204 08:59:53.762890 (+422982us) raft_consensus.cc:1645] Marking committed up to 4
0204 08:59:53.769971 (+ 7081us) log.cc:844] Serialized 14 byte log entry
0204 08:59:53.770199 (+ 228us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:53.770274 (+ 75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:56.833035 (+3062761us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 08:59:56.935873 (+102838us) raft_consensus.cc:1685] finished
0204 08:59:56.935965 (+ 92us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:56.936096 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50230,"prepare.queue_time_us":9637,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":36381,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6542,"spinlock_wait_cycles":14214656,"thread_start_us":354519,"threads_started":1,"wal-append.queue_time_us":766417}
I20260204 08:59:56.884752 20129 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.940621 20129 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.884874 20102 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:56.941773 20102 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:56.888852 18376 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.162s user 0.027s sys 0.031s
W20260204 08:59:56.943048 18376 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.217s user 0.028s sys 0.032s
I20260204 08:59:56.744952 20059 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:56.873775 18373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.148s user 0.024s sys 0.031s
W20260204 08:59:56.944015 18373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.226s user 0.025s sys 0.031s
I20260204 08:59:56.943950 20059 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.944845 18373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 256) took 2478 ms. Trace:
W20260204 08:59:56.745069 18415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:56.945856 20059 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.945176 18373 rpcz_store.cc:276] 0204 08:59:54.466412 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.467636 (+ 1224us) service_pool.cc:225] Handling call
0204 08:59:54.490257 (+ 22621us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:54.570144 (+ 79887us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:54.572406 (+ 2262us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:54.669735 (+ 97329us) log.cc:844] Serialized 26 byte log entry
0204 08:59:56.944498 (+2274763us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:56.944541 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:56.944612 (+ 71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:56.944654 (+ 42us) raft_consensus.cc:1685] finished
0204 08:59:56.944665 (+ 11us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:56.944792 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":47814,"raft.queue_time_us":72157,"spinlock_wait_cycles":21261184,"thread_start_us":2226607,"threads_started":1,"wal-append.queue_time_us":295081,"wal-append.run_cpu_time_us":1603,"wal-append.run_wall_time_us":1001643}
I20260204 08:59:56.949012 20060 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:56.949630 19945 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:56.949474 20060 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:56.950119 19945 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:56.951930 19653 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:56.952045 20060 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:56.952489 19653 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:56.952942 20060 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:56.953462 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:56.954111 18443 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
W20260204 08:59:56.954306 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 81208.4us
I20260204 08:59:56.953341 20060 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.955050 20126 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 08:59:56.955274 19050 connection.cc:232] RPC call timeout handler was delayed by -1.49920935800003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260204 08:59:56.955562 20126 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.956386 20132 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:56.956379 20060 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.955226 20134 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:56.957459 20126 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.957931 19945 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:56.958087 20128 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:56.957036 20132 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.958346 20135 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:56.955178 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:56.959285 18443 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:56.959111 20135 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.960110 20132 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.957026 19653 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.960971 20132 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.961473 20132 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.961880 20135 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.962647 20135 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:56.963315 20132 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.963128 20135 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.958547 20134 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:56.960374 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:56.969437 18443 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 08:59:56.969894 20135 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:56.970376 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:56.971571 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:56.972244 18443 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:56.972589 20134 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.883906 19987 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:56.958631 20128 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:56.967453 19050 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:56.973717 19050 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:56.974267 19987 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:56.974803 19050 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:56.974888 20134 raft_consensus.cc:2804] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:56.975003 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:56.975700 20132 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:56.974414 20128 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:56.975548 20134 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.976449 20132 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:56.975822 18443 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:56.977807 20132 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:56.976797 20134 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:56.984861 18443 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:56.985953 19050 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:56.986725 20128 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:56.987216 20128 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.971560 18376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 761) took 2266 ms. Trace:
I20260204 08:59:56.974464 20135 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:56.987577 20128 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:56.987874 20135 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:56.988436 20135 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:56.987936 20132 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.989285 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 669) took 3669 ms. Trace:
I20260204 08:59:56.990563 20132 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:56.986833 19050 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:56.993575 20132 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:56.994073 20132 raft_consensus.cc:697] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:56.994937 20132 consensus_queue.cc:237] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.995640 20135 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.996789 20128 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.989691 18524 rpcz_store.cc:276] 0204 08:59:53.319732 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.319846 (+ 114us) service_pool.cc:225] Handling call
0204 08:59:53.320136 (+ 290us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:53.320487 (+ 351us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:53.320515 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:53.329861 (+ 9346us) log.cc:844] Serialized 26 byte log entry
0204 08:59:53.986853 (+656992us) raft_consensus.cc:1645] Marking committed up to 4
0204 08:59:54.476456 (+489603us) log.cc:844] Serialized 14 byte log entry
0204 08:59:56.988773 (+2512317us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b1800438ca0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fcebe19dc91 00007fcebe1aa671 00007fceb7f9685c 00007fceb53242eb 00007fcebe114709 00007fceb534057b 00007fceb533e81f 00007fceb533e335 00007fceb83e6ce0 00007fceb83f9396 00007fceb8409f07
0204 08:59:56.988889 (+ 116us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:56.988958 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:56.988996 (+ 38us) raft_consensus.cc:1685] finished
0204 08:59:56.989086 (+ 90us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:56.989210 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":160420,"prepare.queue_time_us":185401,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":13041,"raft.queue_time_us":158054,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":14402,"spinlock_wait_cycles":43344256,"thread_start_us":990792,"threads_started":3,"wal-append.queue_time_us":852192}
I20260204 08:59:56.986315 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.000609 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.001559 20134 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:56.998035 18376 rpcz_store.cc:276] 0204 08:59:54.705358 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.705711 (+ 353us) service_pool.cc:225] Handling call
0204 08:59:54.706582 (+ 871us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:54.706777 (+ 195us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 08:59:56.943467 (+2236690us) log.cc:844] Serialized 14 byte log entry
0204 08:59:56.971205 (+ 27738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:56.971258 (+ 53us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:56.971297 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:56.971358 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:56.971502 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":304717,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":50,"raft.queue_time_us":80,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":245120,"thread_start_us":2243867,"threads_started":2,"wal-append.queue_time_us":27308}
I20260204 08:59:57.012146 20135 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.017519 19824 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.019070 20069 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.030819 20069 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:57.032879 20069 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.023893 19835 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.033587 19835 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:57.034999 19102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.308s user 0.012s sys 0.037s
W20260204 08:59:57.035368 19102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.310s user 0.012s sys 0.037s
I20260204 08:59:57.037572 18368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 954) took 3809 ms. Trace:
I20260204 08:59:57.038023 18368 rpcz_store.cc:276] 0204 08:59:53.227835 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.242007 (+ 14172us) service_pool.cc:225] Handling call
0204 08:59:53.257080 (+ 15073us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:53.724201 (+467121us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.037302 (+3313101us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b540029c554. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:57.037503 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1001528192}
W20260204 08:59:57.032775 18372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34974 (request call id 258) took 2554 ms (client timeout 1823 ms). Trace:
W20260204 08:59:57.040999 18372 rpcz_store.cc:269] 0204 08:59:54.478929 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.479096 (+ 167us) service_pool.cc:225] Handling call
0204 08:59:57.032560 (+2553464us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54005cb054. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:57.032683 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":452907392}
I20260204 08:59:57.041194 20130 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.044104 20130 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.041684 19824 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.035491 19835 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.047750 19824 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.050793 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.051496 18442 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:57.052618 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.053737 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.054806 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.060114 20068 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.060236 20019 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:57.060732 20068 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.061151 20019 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:57.062088 20035 log.cc:927] Time spent T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 3.645s user 0.012s sys 0.015s
I20260204 08:59:57.062733 20068 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.063028 20019 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.063234 20068 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:57.063740 20068 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.063576 20019 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.064924 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.065250 20019 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:57.065563 20068 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:57.066355 19050 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:57.067102 20135 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:57.060508 20069 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:57.067492 20135 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.068250 20135 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
W20260204 08:59:57.068708 18449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.381s user 0.004s sys 0.028s
I20260204 08:59:57.068218 20069 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 08:59:57.069200 18449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.381s user 0.004s sys 0.028s
I20260204 08:59:57.070003 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.070626 20069 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.055428 18442 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:57.071030 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.072618 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:57.067507 20019 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.074191 20019 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:57.074906 20129 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:57.074718 20019 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.075289 20129 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.075672 20129 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.076188 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.073196 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
W20260204 08:59:57.077291 20115 log.cc:927] Time spent T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 2.076s user 0.006s sys 0.009s
I20260204 08:59:57.077472 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:57.077965 18447 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:57.056694 18443 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 08:59:57.077548 18517 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.079125 19102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 752) took 2973 ms. Trace:
I20260204 08:59:57.080605 19913 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.083106 18444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 347) took 3364 ms. Trace:
I20260204 08:59:57.079254 19050 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:57.083467 18444 rpcz_store.cc:276] 0204 08:59:53.718459 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.718741 (+ 282us) service_pool.cc:225] Handling call
0204 08:59:57.082459 (+3363718us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:57.082649 (+ 190us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:57.082805 (+ 156us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:57.082829 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:57.082866 (+ 37us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:57.082892 (+ 26us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.082943 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.083027 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20008320}
I20260204 08:59:57.087875 19050 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:57.088636 20131 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:57.085964 19913 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:57.089214 20129 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.076619 20019 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:57.080039 19102 rpcz_store.cc:276] 0204 08:59:54.105336 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.110818 (+ 5482us) service_pool.cc:225] Handling call
0204 08:59:54.166161 (+ 55343us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:54.489896 (+323735us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:54.496279 (+ 6383us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:54.623797 (+127518us) log.cc:844] Serialized 26 byte log entry
0204 08:59:57.035762 (+2411965us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:57.035805 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.035890 (+ 85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:57.077024 (+ 41134us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b2400515bb8. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5195ad4 00007fceb5193bdb 00007fceb5222ad9 00007fceb5222765 00007fceb5221dad 00007fceb7f724ae 00007fceb7f89c2c 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1
0204 08:59:57.078294 (+ 1270us) raft_consensus.cc:1685] finished
0204 08:59:57.078322 (+ 28us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.078543 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":12061,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":9038720,"thread_start_us":2596540,"threads_started":2,"wal-append.queue_time_us":242947}
I20260204 08:59:57.089748 19913 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:57.092033 19913 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:57.084046 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.095583 18442 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:57.089098 20131 raft_consensus.cc:697] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:57.093451 20135 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:57.091858 19100 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.516s user 0.017s sys 0.042s
I20260204 08:59:57.097484 19050 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:57.098939 19100 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.527s user 0.017s sys 0.043s
I20260204 08:59:57.098802 20125 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:57.100163 20125 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.101203 20125 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:57.096693 20131 consensus_queue.cc:237] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.104800 20135 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.111527 18371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 754) took 3778 ms. Trace:
I20260204 08:59:57.113763 18449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 693) took 2582 ms. Trace:
I20260204 08:59:57.114034 20129 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.115531 18523 raft_consensus.cc:3055] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:57.115911 18523 raft_consensus.cc:740] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:57.116205 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.116920 18522 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 08:59:57.118422 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.118739 18368 raft_consensus.cc:1275] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 08:59:57.119235 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.112059 18371 rpcz_store.cc:276] 0204 08:59:53.333345 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.334307 (+ 962us) service_pool.cc:225] Handling call
0204 08:59:53.396351 (+ 62044us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:53.495140 (+ 98789us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.111228 (+3616088us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b5400250dd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:57.111455 (+ 227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":166256384}
I20260204 08:59:57.116571 18523 consensus_queue.cc:260] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.121197 18523 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.123556 18519 raft_consensus.cc:2393] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 3: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
W20260204 08:59:57.123805 19051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.519s user 0.019s sys 0.031s
I20260204 08:59:57.124734 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.129284 18373 raft_consensus.cc:1240] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260204 08:59:57.130288 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.121134 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.130853 19913 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.131744 19108 raft_consensus.cc:2410] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260204 08:59:57.132164 19108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46704 (request call id 790) took 3659 ms (client timeout 2046 ms). Trace:
I20260204 08:59:57.119414 18524 raft_consensus.cc:1240] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
W20260204 08:59:57.135846 19051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.534s user 0.019s sys 0.031s
I20260204 08:59:57.140080 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.140774 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.141621 18377 raft_consensus.cc:2393] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:57.141964 18523 raft_consensus.cc:1275] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260204 08:59:57.142238 18523 pending_rounds.cc:85] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: Aborting all ops after (but not including) 3
I20260204 08:59:57.142400 18523 pending_rounds.cc:107] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260204 08:59:57.142561 18523 raft_consensus.cc:2889] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260204 08:59:57.132467 19108 rpcz_store.cc:269] 0204 08:59:53.473045 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.474998 (+ 1953us) service_pool.cc:225] Handling call
0204 08:59:57.120996 (+3645998us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:57.132084 (+ 11088us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13990144}
I20260204 08:59:57.153398 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.154341 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.155179 18376 raft_consensus.cc:2410] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for term 8 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260204 08:59:57.114354 18449 rpcz_store.cc:276] 0204 08:59:54.531006 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.531150 (+ 144us) service_pool.cc:225] Handling call
0204 08:59:54.569238 (+ 38088us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 08:59:54.576686 (+ 7448us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:54.576719 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 08:59:54.617207 (+ 40488us) log.cc:844] Serialized 52 byte log entry
0204 08:59:57.069579 (+2452372us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:57.085266 (+ 15687us) log.cc:844] Serialized 14 byte log entry
0204 08:59:57.113352 (+ 28086us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.113513 (+ 161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:57.113559 (+ 46us) raft_consensus.cc:1685] finished
0204 08:59:57.113572 (+ 13us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.113701 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":32607,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":9740,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":16536,"thread_start_us":2424306,"threads_started":3,"wal-append.queue_time_us":271656,"wal-append.run_cpu_time_us":1590,"wal-append.run_wall_time_us":1001623}
I20260204 08:59:57.156373 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.158047 19100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46718 (request call id 672) took 2670 ms. Trace:
I20260204 08:59:57.158527 19100 rpcz_store.cc:276] 0204 08:59:54.488132 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.488300 (+ 168us) service_pool.cc:225] Handling call
0204 08:59:54.528005 (+ 39705us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:54.528209 (+ 204us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 08:59:57.099253 (+2571044us) log.cc:844] Serialized 14 byte log entry
0204 08:59:57.157703 (+ 58450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:57.157751 (+ 48us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:57.157792 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.157853 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.158000 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15330,"prepare.queue_time_us":178442,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3014,"thread_start_us":2585028,"threads_started":2}
I20260204 08:59:57.161051 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.162364 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.162947 18370 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:57.146199 20131 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.162658 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.166920 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.145660 20082 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:57.168751 18517 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:57.186899 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.169559 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.191697 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.191797 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.192308 18375 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:57.192919 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.193536 18377 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:57.194191 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.194821 18376 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:57.179695 18369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 951) took 3954 ms. Trace:
I20260204 08:59:57.176470 19913 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.198096 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.198732 18370 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:57.171640 20130 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.176949 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.201152 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.201687 19913 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:57.179920 20125 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.177488 20131 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.205216 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.178191 20082 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.207108 18516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 668) took 3892 ms. Trace:
I20260204 08:59:57.203125 19913 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.207167 20131 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.203393 20147 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:57.196911 18369 rpcz_store.cc:276] 0204 08:59:53.225301 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.242056 (+ 16755us) service_pool.cc:225] Handling call
0204 08:59:53.257530 (+ 15474us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:53.503469 (+245939us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.179397 (+3675928us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54005c9c54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:57.179616 (+ 219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":512696192}
I20260204 08:59:57.211968 18446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 346) took 3525 ms. Trace:
I20260204 08:59:57.210776 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.210842 19099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 754) took 3104 ms. Trace:
I20260204 08:59:57.215020 18368 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:57.215397 20082 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:57.218822 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.217798 19913 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.207726 18516 rpcz_store.cc:276] 0204 08:59:53.314862 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.316583 (+ 1721us) service_pool.cc:225] Handling call
0204 08:59:56.760469 (+3443886us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:56.760710 (+ 241us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:57.014899 (+254189us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:57.014924 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:57.029820 (+ 14896us) log.cc:844] Serialized 26 byte log entry
0204 08:59:57.097986 (+ 68166us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:57.193215 (+ 95229us) log.cc:844] Serialized 14 byte log entry
0204 08:59:57.200285 (+ 7070us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.203672 (+ 3387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:57.203726 (+ 54us) raft_consensus.cc:1685] finished
0204 08:59:57.203822 (+ 96us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.207048 (+ 3226us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":258159,"raft.queue_time_us":257244,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"spinlock_wait_cycles":11394560,"thread_start_us":133649,"threads_started":2,"wal-append.queue_time_us":113799}
I20260204 08:59:57.220485 19050 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.213042 20153 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 08:59:57.216756 20104 log.cc:927] Time spent T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 2.481s user 0.033s sys 0.035s
I20260204 08:59:57.223752 19050 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:57.213938 20147 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.214674 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.228303 20147 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.214380 18446 rpcz_store.cc:276] 0204 08:59:53.686253 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.690491 (+ 4238us) service_pool.cc:225] Handling call
0204 08:59:53.734876 (+ 44385us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:53.735267 (+ 391us) raft_consensus.cc:1534] Early marking committed up to index 2
0204 08:59:53.735300 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:53.735783 (+ 483us) log.cc:844] Serialized 26 byte log entry
0204 08:59:54.300960 (+565177us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:54.302291 (+ 1331us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:54.303072 (+ 781us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:57.201465 (+2898393us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b2400483578. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5195ad4 00007fceb5193bdb 00007fceb5222ad9 00007fceb5222765 00007fceb5221cc0 00007fceb7fb6828 00007fceb7fb6f88 00007fceb7f8e738 00007fceb7f89b0a 00007fceb7f88f56
0204 08:59:57.201908 (+ 443us) raft_consensus.cc:1685] finished
0204 08:59:57.201941 (+ 33us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.211455 (+ 9514us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1064,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":64000768,"thread_start_us":562705,"threads_started":1,"wal-append.queue_time_us":606703}
I20260204 08:59:57.227526 18373 raft_consensus.cc:2393] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
W20260204 08:59:57.229794 18340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.587s user 0.014s sys 0.037s
I20260204 08:59:57.216445 20125 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.230520 18448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 958) took 3860 ms. Trace:
I20260204 08:59:57.252486 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:57.230187 18340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.607s user 0.014s sys 0.037s
W20260204 08:59:57.272723 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 2.68698e+06us
I20260204 08:59:57.273558 18340 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:57.251096 18414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 08:59:57.274492 18414 connection.cc:232] RPC call timeout handler was delayed by -1.5181962460000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260204 08:59:57.274717 18414 connection.cc:232] RPC call timeout handler was delayed by -1.4542962460000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260204 08:59:57.274878 18414 connection.cc:232] RPC call timeout handler was delayed by -1.4542962460000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260204 08:59:57.275030 18414 connection.cc:232] RPC call timeout handler was delayed by -1.2971052180000697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260204 08:59:57.275180 18414 connection.cc:232] RPC call timeout handler was delayed by -1.0447962460000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260204 08:59:57.275331 18414 connection.cc:232] RPC call timeout handler was delayed by -1.0447962460000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260204 08:59:57.277704 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 54031.9us
I20260204 08:59:57.278498 19050 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.275897 18445 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 08:59:57.271895 18448 rpcz_store.cc:276] 0204 08:59:53.370566 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.371676 (+ 1110us) service_pool.cc:225] Handling call
0204 08:59:53.408639 (+ 36963us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:53.451697 (+ 43058us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:53.451729 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:57.173376 (+3721647us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b2c000f1f78. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb6ced9b1 00007fceb6cfcfe2 00007fceb842a851 00007fceb83ef0ba 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22
0204 08:59:57.173766 (+ 390us) log.cc:844] Serialized 26 byte log entry
0204 08:59:57.202702 (+ 28936us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:57.202785 (+ 83us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.202852 (+ 67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:57.230222 (+ 27370us) raft_consensus.cc:1685] finished
0204 08:59:57.230241 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.230463 (+ 222us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45786,"raft.queue_time_us":43111,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":25824,"spinlock_wait_cycles":10952448,"thread_start_us":28610,"threads_started":1,"wal-append.queue_time_us":39683}
I20260204 08:59:57.279433 19873 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.280766 20135 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:57.279624 19050 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:57.283206 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.223033 19913 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:57.250294 20134 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.283578 19050 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:57.284862 18340 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.282857 20135 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 08:59:57.286332 18445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47922 (request call id 688) took 3474 ms (client timeout 1974 ms). Trace:
W20260204 08:59:57.242319 18231 debug-util.cc:398] Leaking SignalData structure 0x7b0800050a40 after lost signal to thread 18234
I20260204 08:59:57.286952 19050 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.280476 20147 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:57.215329 19099 rpcz_store.cc:276] 0204 08:59:54.106555 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.110700 (+ 4145us) service_pool.cc:225] Handling call
0204 08:59:54.754111 (+643411us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:54.754330 (+ 219us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:54.829023 (+ 74693us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:54.830162 (+ 1139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:54.838231 (+ 8069us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:54.839513 (+ 1282us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.210614 (+2371101us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b54002a21d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:57.210666 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.210787 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":153677824}
I20260204 08:59:57.290285 20135 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.285620 20131 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:57.290964 20131 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.291155 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:57.291546 18343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.668s user 0.014s sys 0.049s
W20260204 08:59:57.288360 18445 rpcz_store.cc:269] 0204 08:59:53.805165 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.085946 (+280781us) service_pool.cc:225] Handling call
0204 08:59:57.252322 (+3166376us) spinlock_profiling.cc:243] Waited 986 us on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:57.279684 (+ 27362us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2268544}
W20260204 08:59:57.293715 18343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.671s user 0.015s sys 0.049s
I20260204 08:59:57.292234 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.293838 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.290875 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.295030 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.295636 18370 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 08:59:57.296504 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.297343 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:57.298291 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 2.67825e+06us
I20260204 08:59:57.299455 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.300089 18522 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:57.298062 20147 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.290448 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.306825 20147 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.306584 20135 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.287801 20079 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:57.307171 18369 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 08:59:57.280970 19873 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:57.308153 18376 raft_consensus.cc:2393] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 08:59:57.308442 20135 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.292016 20131 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:57.308669 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.310410 19099 raft_consensus.cc:1240] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:57.286644 19913 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:57.286154 20082 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 08:59:57.312492 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.310858 19050 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:57.227712 20153 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.303344 18517 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 08:59:57.315605 19836 raft_consensus.cc:3055] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:57.311631 19965 consensus_queue.cc:1048] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260204 08:59:57.304972 20081 consensus_queue.cc:1048] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260204 08:59:57.313275 19913 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:57.315825 20135 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:57.325790 20135 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.326170 20135 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.326694 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.303166 20125 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:57.317914 19964 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:57.311892 20064 consensus_queue.cc:1048] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260204 08:59:57.327929 19964 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:57.328896 18451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 696) took 2795 ms. Trace:
I20260204 08:59:57.329264 18451 rpcz_store.cc:276] 0204 08:59:54.533065 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.556859 (+ 23794us) service_pool.cc:225] Handling call
0204 08:59:54.557112 (+ 253us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:54.561556 (+ 4444us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:54.561585 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:54.561623 (+ 38us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:54.561650 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.328680 (+2767030us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b5400624154. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 08:59:57.328728 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:57.328845 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9830656}
W20260204 08:59:57.318527 18340 connection.cc:232] RPC call timeout handler was delayed by -1.7111067339999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260204 08:59:57.320885 19745 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 08:59:57.324021 18488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.749s user 0.031s sys 0.039s
W20260204 08:59:57.323848 18343 connection.cc:232] RPC call timeout handler was delayed by -1.7595700529999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260204 08:59:57.330807 18491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.641s user 0.005s sys 0.031s
I20260204 08:59:57.330962 19109 raft_consensus.cc:1240] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:57.333638 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.337349 18414 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 08:59:57.345813 18488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.772s user 0.031s sys 0.039s
I20260204 08:59:57.347536 18414 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:57.329850 19964 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:57.348711 18491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.660s user 0.007s sys 0.032s
W20260204 08:59:57.346194 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 2.77235e+06us
W20260204 08:59:57.349531 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 2.66085e+06us
I20260204 08:59:57.353699 18491 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.324889 19836 raft_consensus.cc:740] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:57.369765 20080 consensus_queue.cc:1059] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:57.370023 20135 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.370117 19836 consensus_queue.cc:260] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.372198 19642 raft_consensus.cc:3055] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:57.372629 19642 raft_consensus.cc:740] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:57.373320 19642 consensus_queue.cc:260] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.374210 19642 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.331091 20147 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.377512 19963 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:57.378350 19102 raft_consensus.cc:2393] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:57.348454 19646 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 08:59:57.349195 20064 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:57.348721 19745 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.378680 19821 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.379200 20064 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.345527 19891 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:57.379626 20064 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:57.379944 19821 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.339073 20125 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.366658 19660 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:57.384369 20125 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.384413 19660 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:57.363718 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.332427 20153 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.385262 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.378031 19963 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.378774 19646 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:57.379428 20081 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.401511 20081 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:57.401916 20131 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 08:59:57.402791 18417 connection.cc:232] RPC call timeout handler was delayed by -1.4690304040001365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260204 08:59:57.403162 18417 connection.cc:232] RPC call timeout handler was delayed by -1.0345139220000874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260204 08:59:57.403767 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.405298 19633 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.405475 19952 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.405653 20102 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.382797 19745 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:57.406872 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.400589 18373 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:57.371209 20080 consensus_queue.cc:1059] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:57.366187 18375 raft_consensus.cc:1240] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:57.411823 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.371088 19836 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:57.412489 19106 raft_consensus.cc:2393] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 6: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:57.414058 19963 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.416054 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.383706 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.387125 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.372253 19107 raft_consensus.cc:1240] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:57.367069 18491 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.419042 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:57.419720 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 52729.6us
I20260204 08:59:57.391059 18340 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:57.393194 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.420424 18377 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:57.422381 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.383440 19891 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.393858 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.405817 19633 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.431880 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.432485 18371 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 08:59:57.372234 19099 raft_consensus.cc:1240] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:57.433316 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.433785 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.403391 20081 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.435171 19973 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:57.435587 19973 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.435958 19973 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:57.436826 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.395210 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.384538 20147 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.397485 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.398861 20064 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:57.400238 19646 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 08:59:57.385368 19660 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.396530 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.382124 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.396601 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.419731 19109 raft_consensus.cc:2393] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:57.423394 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.425143 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.425438 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.426318 18491 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.427039 19814 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 08:59:57.476998 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 50782us
I20260204 08:59:57.477919 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.427542 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.428037 19821 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.482173 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.428486 19952 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.428942 19891 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:57.429214 19913 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.443177 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.425362 18414 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:57.440853 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 49886.4us
I20260204 08:59:57.443058 20080 consensus_queue.cc:1059] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:57.443190 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.443414 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.443825 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 08:59:57.445549 18488 connection.cc:232] RPC call timeout handler was delayed by -1.2014535250000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260204 08:59:57.437949 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.498335 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.498773 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.433377 19633 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:57.485827 18448 raft_consensus.cc:2393] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 6: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:57.485857 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.485242 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.501734 18375 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.487371 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.503006 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.469247 19987 consensus_queue.cc:1059] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260204 08:59:57.429567 18368 raft_consensus.cc:1275] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260204 08:59:57.492473 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 08:59:57.493547 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 68268us
I20260204 08:59:57.495026 19107 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 7.
I20260204 08:59:57.496882 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.466610 19794 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:57.505110 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:57.491495 18231 debug-util.cc:398] Leaking SignalData structure 0x7b0800050bc0 after lost signal to thread 18254
I20260204 08:59:57.494609 18370 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 08:59:57.499755 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.497119 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.514014 18524 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
W20260204 08:59:57.468642 18415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:57.499320 18444 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:57.466001 18446 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 08:59:57.465189 20156 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:57.503556 19109 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:57.505770 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.477675 20065 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:57.545336 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.510308 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.511070 18417 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.546077 19107 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:57.545389 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.546984 18417 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.548135 18417 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:57.548725 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:57.511410 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:57.513593 18376 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.485154 20135 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.551695 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.500391 18373 raft_consensus.cc:2410] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260204 08:59:57.555797 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.516479 18414 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.492146 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.509720 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.552213 18451 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:57.562001 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:57.562732 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.563133 19109 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.562222 18377 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:57.553810 18370 raft_consensus.cc:1275] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:57.520713 19104 raft_consensus.cc:1240] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:57.555330 19050 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:57.555775 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.570284 18370 raft_consensus.cc:3055] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
W20260204 08:59:57.561394 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 102620us
I20260204 08:59:57.502080 19821 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:57.557507 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.558259 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.558593 19951 raft_consensus.cc:2749] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:57.559033 19963 raft_consensus.cc:2804] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:57.558943 20130 consensus_queue.cc:1048] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260204 08:59:57.521183 19814 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.521186 19794 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.603623 18447 raft_consensus.cc:2410] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260204 08:59:57.571301 18443 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:57.560704 20125 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.522727 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.552801 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.506824 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.520774 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.570498 18488 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.570755 18370 raft_consensus.cc:740] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:57.574198 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.574786 18340 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:57.576714 18523 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:57.580999 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.580178 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.572898 18343 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:57.590588 19107 raft_consensus.cc:1240] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:57.588361 18371 raft_consensus.cc:1240] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:57.573755 20131 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.521183 20009 consensus_queue.cc:1059] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260204 08:59:57.612949 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.599663 19963 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.552037 19993 consensus_queue.cc:1048] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260204 08:59:57.560249 20081 consensus_queue.cc:1048] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:57.608282 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:57.623482 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:57.563287 19898 consensus_queue.cc:1048] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260204 08:59:57.571085 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.605417 20154 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 08:59:57.597154 19109 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 08:59:57.626732 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.616891 18521 raft_consensus.cc:2393] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:57.601938 18376 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
W20260204 08:59:57.619391 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 102997us
I20260204 08:59:57.604156 19633 raft_consensus.cc:2804] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:57.619616 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 08:59:57.611137 18231 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3160 after lost signal to thread 18401
I20260204 08:59:57.622359 19100 raft_consensus.cc:2393] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 08:59:57.618374 18518 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 08:59:57.557057 19859 consensus_queue.cc:1048] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260204 08:59:57.623749 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.613904 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.683143 18522 raft_consensus.cc:2393] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:57.590006 20135 consensus_queue.cc:1048] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260204 08:59:57.644899 18446 raft_consensus.cc:2393] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:57.688036 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:57.688267 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:57.688858 19101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46720 (request call id 753) took 3582 ms (client timeout 1595 ms). Trace:
I20260204 08:59:57.609302 18451 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 08:59:57.646472 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:57.689263 19101 rpcz_store.cc:269] 0204 08:59:54.105938 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:54.110749 (+ 4811us) service_pool.cc:225] Handling call
0204 08:59:57.687888 (+3577139us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 08:59:57.688795 (+ 907us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16877440}
I20260204 08:59:57.690124 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:57.691035 20160 log.cc:927] Time spent T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
I20260204 08:59:57.621184 18517 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:57.691165 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.691749 18445 raft_consensus.cc:2468] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:57.692020 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.692500 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.693127 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.691184 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.694191 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.694376 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 08:59:57.653026 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 94798us
I20260204 08:59:57.695381 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.695951 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:57.696883 19821 consensus_queue.cc:1048] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 08:59:57.699398 18417 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.700640 18417 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.701510 19050 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.680446 19633 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:57.703235 19633 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:57.666661 20140 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:57.704228 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:57.704911 18442 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 08:59:57.705600 19913 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:57.706305 20158 log.cc:927] Time spent T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.195s user 0.000s sys 0.000s
I20260204 08:59:57.706856 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.646157 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.622906 19963 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:57.618834 20082 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 08:59:57.673815 18523 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 08:59:57.622283 19642 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260204 08:59:57.675416 18414 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:57.607898 19814 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.684798 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.694617 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.693509 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.689024 18446 raft_consensus.cc:2410] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260204 08:59:57.710039 18451 raft_consensus.cc:1240] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:57.718237 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.729444 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.730389 19814 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.716545 19938 raft_consensus.cc:2764] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260204 08:59:57.692512 19988 raft_consensus.cc:3055] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 08:59:57.726657 19642 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 08:59:57.725690 19859 raft_consensus.cc:2749] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:57.719282 19660 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:57.708346 19952 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.716001 19973 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:57.690425 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.722688 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:57.668025 20064 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 08:59:57.707820 18231 debug-util.cc:398] Leaking SignalData structure 0x7b080007df20 after lost signal to thread 18402
I20260204 08:59:57.624461 18370 consensus_queue.cc:260] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.693471 19745 raft_consensus.cc:3055] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:57.763584 19745 raft_consensus.cc:740] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:57.764149 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.764396 19745 consensus_queue.cc:260] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.765220 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:57.695261 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.766144 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.726420 18522 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:57.766702 18518 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:57.767174 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:57.726821 20082 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 08:59:57.767954 20082 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 08:59:57.768208 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.768786 18522 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 2.
I20260204 08:59:57.769461 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.732853 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.722437 19050 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:57.771260 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 48897.1us
I20260204 08:59:57.771363 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.771993 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.772351 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.773301 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:57.774572 19952 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:57.731595 19107 raft_consensus.cc:1240] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:57.777456 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.778358 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.779897 18522 raft_consensus.cc:2393] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 08:59:57.741595 20079 raft_consensus.cc:3055] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:57.766291 18517 raft_consensus.cc:2410] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260204 08:59:57.778765 18376 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:57.720723 19873 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.730458 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:57.732262 19988 raft_consensus.cc:740] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:57.746845 19973 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.767446 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:57.779269 18375 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:57.781916 19050 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:57.830911 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 55260.8us
I20260204 08:59:57.831723 19050 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:57.761761 18491 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.732633 19642 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Advancing to term 8
I20260204 08:59:57.763633 19794 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:57.709164 19109 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
I20260204 08:59:57.780628 20130 raft_consensus.cc:2749] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:57.745639 19102 raft_consensus.cc:1240] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:57.745121 20125 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.744413 20081 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:57.756619 18444 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:57.746351 20168 raft_consensus.cc:2749] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:57.792249 18523 raft_consensus.cc:1275] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:57.792162 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 08:59:57.792404 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 221980us
I20260204 08:59:57.855927 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:57.737252 19660 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:57.764333 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:57.835562 20102 raft_consensus.cc:2749] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:57.837484 19050 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:57.736097 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:57.859630 18520 raft_consensus.cc:2410] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260204 08:59:57.788544 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 170499us
I20260204 08:59:57.785988 19859 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:57.790539 19745 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:57.783087 20079 raft_consensus.cc:740] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:57.851082 18376 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:57.739480 19646 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.833632 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.854662 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:57.835490 19993 raft_consensus.cc:2749] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260204 08:59:57.832765 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 71091.4us
I20260204 08:59:57.926363 18491 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:57.927242 18491 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:57.862056 18377 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:57.840732 19913 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:57.840521 19109 raft_consensus.cc:606] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.930476 19109 raft_consensus.cc:614] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 08:59:57.938359 19105 raft_consensus.cc:1240] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
W20260204 08:59:57.942147 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 72042us
I20260204 08:59:57.866236 19107 raft_consensus.cc:1275] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 08:59:57.869186 19050 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 08:59:57.924667 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 56428.5us
I20260204 08:59:57.863989 19980 consensus_queue.cc:1059] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260204 08:59:57.861632 19633 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:57.921844 20125 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260204 08:59:57.970765 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 101626us
I20260204 08:59:57.932441 19660 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:57.966645 19100 raft_consensus.cc:1240] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:57.984516 19050 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.985953 19660 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:57.986454 19660 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:57.932103 20140 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:57.982759 19913 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:57.993220 18343 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:57.994630 19633 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:57.995460 18449 raft_consensus.cc:2393] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 3: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 08:59:57.990850 19050 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:58.040236 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 364886us
W20260204 08:59:58.040483 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 339895us
W20260204 08:59:58.068012 18231 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3ee0 after lost signal to thread 18475
W20260204 08:59:58.068452 18231 debug-util.cc:398] Leaking SignalData structure 0x7b080010b780 after lost signal to thread 18476
W20260204 08:59:58.073012 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 82231.9us
W20260204 08:59:58.073707 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 145464us
I20260204 08:59:58.073971 19050 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 08:59:58.075902 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 82748.9us
I20260204 08:59:57.923624 20172 consensus_queue.cc:1048] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260204 08:59:58.075978 19050 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:58.076563 18491 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 08:59:58.079770 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 122248us
W20260204 08:59:58.073402 20178 log.cc:927] Time spent T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.110s user 0.001s sys 0.000s
I20260204 08:59:58.088205 18488 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:58.088861 20009 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 08:59:58.089262 20009 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:58.089624 20009 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 08:59:58.090467 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:57.870852 19988 consensus_queue.cc:260] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:57.974323 18443 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 08:59:58.095079 18451 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:57.983556 20125 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:58.097925 18375 raft_consensus.cc:1275] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260204 08:59:58.092913 18491 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:58.083055 19050 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:57.992027 19993 raft_consensus.cc:2749] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:58.095803 18488 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:57.991882 20140 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:58.080304 19859 raft_consensus.cc:2749] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:58.097571 20019 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:58.121064 20019 raft_consensus.cc:697] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:58.121922 20019 consensus_queue.cc:237] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:57.993362 19913 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:58.124331 19913 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:58.079677 20080 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 08:59:58.112607 20140 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:58.105583 19893 consensus_queue.cc:1048] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260204 08:59:58.106242 20125 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:58.081136 19633 consensus_queue.cc:1059] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260204 08:59:58.115586 20102 raft_consensus.cc:2749] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:58.078516 19814 consensus_queue.cc:1059] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260204 08:59:58.118245 18442 raft_consensus.cc:1240] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: []
W20260204 08:59:58.119817 18231 debug-util.cc:398] Leaking SignalData structure 0x7b080013a9c0 after lost signal to thread 18549
I20260204 08:59:58.120350 19646 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:58.114888 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:58.097267 19102 raft_consensus.cc:1275] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260204 08:59:58.160694 18443 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
W20260204 08:59:58.158044 18231 debug-util.cc:398] Leaking SignalData structure 0x7b08002304e0 after lost signal to thread 18550
W20260204 08:59:58.162299 18231 debug-util.cc:398] Leaking SignalData structure 0x7b080038f260 after lost signal to thread 19135
I20260204 08:59:58.113130 19983 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:58.163094 19983 raft_consensus.cc:697] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
W20260204 08:59:58.152372 20170 log.cc:927] Time spent T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.226s user 0.000s sys 0.002s
I20260204 08:59:58.078567 20171 consensus_queue.cc:1048] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.137s
I20260204 08:59:58.098932 19980 raft_consensus.cc:2764] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260204 08:59:58.146615 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 50889.5us
I20260204 08:59:58.072075 20079 consensus_queue.cc:260] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:58.150928 20173 raft_consensus.cc:2804] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:58.193769 18488 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:58.194974 18488 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:58.114485 18491 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:58.120396 18414 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:58.172044 19050 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:58.163966 19983 consensus_queue.cc:237] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:58.183037 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 70900us
W20260204 08:59:58.197160 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 90215.4us
I20260204 08:59:58.204052 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:58.212234 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:58.198925 19050 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:58.165071 20133 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260204 08:59:58.224642 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 104322us
I20260204 08:59:58.225916 18414 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.237529 19050 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 08:59:58.221773 19993 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:58.198029 20102 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 08:59:58.222379 19980 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:58.197743 20173 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:58.240665 19898 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election won for term 4
I20260204 08:59:58.247691 20130 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:58.238971 20080 consensus_queue.cc:1059] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260204 08:59:58.238740 20175 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 08:59:58.236830 20169 raft_consensus.cc:2749] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:58.222858 19660 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 08:59:58.263589 19963 consensus_meta.cc:287] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.537s user 0.006s sys 0.003s
I20260204 08:59:58.259210 20173 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:58.265223 20172 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:58.297175 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:58.297986 18443 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 08:59:58.298437 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:58.299190 18443 raft_consensus.cc:1240] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:58.300717 19660 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:58.322050 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 207622us
I20260204 08:59:58.339679 20172 consensus_queue.cc:1059] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:58.340597 20172 raft_consensus.cc:3055] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 08:59:58.330772 19913 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:58.340946 20172 raft_consensus.cc:740] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:58.341763 20172 consensus_queue.cc:260] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:58.342371 19913 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:58.342913 20172 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
W20260204 08:59:58.343919 20177 log.cc:927] Time spent T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
W20260204 08:59:58.330478 20082 consensus_meta.cc:287] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.547s user 0.009s sys 0.000s
I20260204 08:59:58.344844 20082 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:58.346621 20082 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:58.340155 18443 raft_consensus.cc:1240] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:58.285506 19963 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:58.359263 20185 log.cc:927] Time spent T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
W20260204 08:59:58.363341 19642 consensus_meta.cc:287] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.517s user 0.004s sys 0.005s
I20260204 08:59:58.349596 19660 consensus_queue.cc:1059] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260204 08:59:58.358785 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 91512.9us
I20260204 08:59:58.378809 18340 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 08:59:58.361718 19952 consensus_meta.cc:287] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.587s user 0.006s sys 0.001s
W20260204 08:59:58.363740 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 137896us
I20260204 08:59:58.397879 18488 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.405522 18414 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.406700 18414 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:58.411334 18340 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.420611 18414 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:58.422187 18340 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.359275 19814 consensus_queue.cc:1048] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260204 08:59:58.417480 18450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 348) took 4695 ms. Trace:
I20260204 08:59:58.431595 18340 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.432859 18340 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.433323 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:58.434005 18340 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.418835 19952 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 08:59:58.425040 18450 rpcz_store.cc:276] 0204 08:59:53.721771 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.722059 (+ 288us) service_pool.cc:225] Handling call
0204 08:59:58.069099 (+4347040us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 08:59:58.071820 (+ 2721us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:58.072133 (+ 313us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:58.072155 (+ 22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:58.073077 (+ 922us) log.cc:844] Serialized 26 byte log entry
0204 08:59:58.254947 (+181870us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:58.254986 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:58.255059 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:58.417166 (+162107us) raft_consensus.cc:1685] finished
0204 08:59:58.417187 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 08:59:58.417401 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17083264,"thread_start_us":151738,"threads_started":1,"wal-append.queue_time_us":306830}
I20260204 08:59:58.436388 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:58.436914 18446 raft_consensus.cc:1240] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:58.438395 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:58.464751 20194 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:58.423563 19985 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:58.430619 19781 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:58.415128 20081 raft_consensus.cc:2749] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:58.369827 20009 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:58.416273 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:58.459582 19745 raft_consensus.cc:2749] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:58.442740 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:58.418717 20190 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:58.444360 18368 raft_consensus.cc:1240] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260204 08:59:58.434240 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:58.473701 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:58.431304 18377 raft_consensus.cc:1240] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:58.475445 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:58.445667 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 08:59:58.440225 18372 raft_consensus.cc:1240] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260204 08:59:58.431143 19973 raft_consensus.cc:2804] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 08:59:58.453142 19963 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:58.414958 20154 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:58.374367 19980 consensus_queue.cc:1059] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260204 08:59:58.385222 19642 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:58.408331 20140 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:58.418483 20173 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:58.457406 19821 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 08:59:58.414274 19104 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 6. Ops: []
I20260204 08:59:58.459672 20006 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:58.461994 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:58.466930 18340 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.441696 20128 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:58.468266 18521 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 08:59:58.470029 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:58.470582 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 08:59:58.479384 19105 raft_consensus.cc:1240] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
I20260204 08:59:58.481621 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:58.506500 18376 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 08:59:58.507388 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:58.486670 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:58.478955 19973 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:58.472374 19964 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:58.466562 19781 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 08:59:58.492703 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 247763us
I20260204 08:59:58.478211 20171 raft_consensus.cc:2749] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 08:59:58.468904 19898 raft_consensus.cc:697] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:58.483598 20154 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 08:59:58.503821 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 08:59:58.510684 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 43815.6us
I20260204 08:59:58.513025 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:58.529528 19107 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:58.514210 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 08:59:58.531055 18340 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.478250 20130 raft_consensus.cc:697] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:58.488903 20082 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:58.525923 18518 raft_consensus.cc:1240] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:58.522845 19050 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.479049 20190 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:58.502871 19821 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 08:59:58.491577 19993 raft_consensus.cc:697] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 08:59:58.533663 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 08:59:58.513634 19973 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:58.516105 19781 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:58.526039 19983 consensus_queue.cc:1048] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
W20260204 08:59:58.580317 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 57545.6us
I20260204 08:59:58.581079 19050 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.582399 19050 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:58.535797 18450 raft_consensus.cc:1240] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 08:59:58.511754 19745 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 08:59:58.504344 20125 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:58.557173 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 08:59:58.559934 19898 consensus_queue.cc:237] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:58.553813 18377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
from {username='slave'} at 127.0.0.1:34972
I20260204 08:59:58.502719 20175 raft_consensus.cc:697] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:58.561715 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 08:59:58.565176 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:58.587846 18377 raft_consensus.cc:606] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Received request to transfer leadership to TS 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.566315 19107 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 08:59:58.536367 18517 raft_consensus.cc:1240] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:58.538517 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 08:59:58.573354 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 143019us
W20260204 08:59:58.576108 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 174447us
I20260204 08:59:58.539026 18376 raft_consensus.cc:2468] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 7.
I20260204 08:59:58.560738 20140 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:58.586120 19050 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.596205 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.570991 19821 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:58.608336 19107 raft_consensus.cc:1240] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:58.570823 19964 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:58.621706 19099 raft_consensus.cc:1240] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 5. Current term is 6. Ops: []
I20260204 08:59:58.584568 19983 consensus_queue.cc:1243] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer 44601d9bf1ce4a70a5b01dcfc505d276 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260204 08:59:58.569453 20082 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:58.634136 20196 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 08:59:58.635667 20196 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:58.621547 19745 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:58.636401 19050 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.637313 20196 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:58.635864 20175 consensus_queue.cc:237] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:58.643350 20169 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:58.643862 20169 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:58.644786 20082 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:58.645376 20082 consensus_queue.cc:1059] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 08:59:58.645892 20169 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:58.648886 18414 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 08:59:58.650615 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 80205.8us
I20260204 08:59:58.629902 20009 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:58.655417 19050 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.652582 18414 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 08:59:58.654870 18340 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 08:59:58.656317 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:58.609522 19993 consensus_queue.cc:237] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:58.659044 18524 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 08:59:58.659768 18340 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 08:59:58.661839 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 08:59:58.652516 20191 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:58.664410 18491 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 08:59:58.652045 19642 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:58.659610 20193 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:58.652858 20207 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 08:59:58.674158 18524 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 08:59:58.649690 19745 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:58.685638 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 08:59:58.634596 20130 consensus_queue.cc:237] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:58.689281 18524 raft_consensus.cc:1240] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260204 08:59:58.669059 19964 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:58.756237 20190 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 08:59:58.757824 20154 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:58.758874 19107 raft_consensus.cc:1240] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 6. Current term is 7. Ops: []
I20260204 08:59:58.665431 20173 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:58.667773 20202 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:58.666460 20195 raft_consensus.cc:2804] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 08:59:58.686170 20201 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 08:59:58.684700 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 08:59:58.688668 20193 raft_consensus.cc:697] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 08:59:58.764603 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 70767.2us
I20260204 08:59:58.689203 19980 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 08:59:58.692302 19983 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 08:59:58.787883 18414 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 08:59:58.692205 20220 raft_consensus.cc:2749] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 08:59:58.774417 20207 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 08:59:58.695472 20169 consensus_queue.cc:1059] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260204 08:59:58.794898 20169 raft_consensus.cc:2804] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader election won for term 7
I20260204 08:59:58.795323 20169 raft_consensus.cc:697] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [term 7 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 08:59:58.785261 19963 consensus_queue.cc:1059] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260204 08:59:58.796141 20169 consensus_queue.cc:237] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:58.790529 20125 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:58.812870 20202 raft_consensus.cc:3055] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:58.767794 20195 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 08:59:58.783398 19952 consensus_queue.cc:1059] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260204 08:59:58.813318 20202 raft_consensus.cc:740] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 08:59:58.832263 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 236109us
I20260204 08:59:58.820585 20207 raft_consensus.cc:697] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 08:59:58.807307 19973 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:58.789880 19980 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 08:59:58.821398 20195 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 08:59:58.795389 19642 consensus_queue.cc:1059] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260204 08:59:58.853125 19642 raft_consensus.cc:3055] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 08:59:58.853483 19642 raft_consensus.cc:740] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 08:59:58.854219 19642 consensus_queue.cc:260] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 08:59:58.848822 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 166818us
I20260204 08:59:58.839745 19821 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.074577 19821 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 08:59:58.860636 20212 log.cc:927] Time spent T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.190s user 0.000s sys 0.001s
W20260204 08:59:58.860613 20204 log.cc:927] Time spent T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.181s user 0.000s sys 0.001s
I20260204 08:59:58.861487 20206 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:58.862323 19745 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:58.862587 19893 raft_consensus.cc:3055] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 08:59:58.850658 20193 consensus_queue.cc:237] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.075860 20206 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.078651 20206 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:58.863453 19973 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 08:59:58.847841 18488 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:00.251523 18370 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
W20260204 09:00:00.992854 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.207881 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:01.210053 18516 raft_consensus.cc:1240] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260204 08:59:58.850752 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 195400us
W20260204 08:59:58.881754 18448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47922 (request call id 700) took 1499 ms (client timeout 1889 ms). Trace:
W20260204 09:00:01.488065 18448 rpcz_store.cc:269] 0204 08:59:57.382759 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.383157 (+ 398us) service_pool.cc:225] Handling call
0204 08:59:58.881521 (+1498364us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x7b54005efbd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 08:59:58.881690 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":229985792}
I20260204 08:59:58.895622 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:01.491869 19106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46718 (request call id 696) took 3406 ms (client timeout 1941 ms). Trace:
W20260204 09:00:01.492255 19106 rpcz_store.cc:269] 0204 08:59:58.084865 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.088807 (+ 3942us) service_pool.cc:225] Handling call
0204 08:59:58.895466 (+806659us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:01.491640 (+2596174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10692352}
I20260204 09:00:01.493906 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:01.494709 19106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46704 (request call id 826) took 2730 ms (client timeout 2899 ms). Trace:
W20260204 09:00:01.495029 19106 rpcz_store.cc:269] 0204 08:59:58.764646 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.493438 (+2728792us) service_pool.cc:225] Handling call
0204 09:00:01.494645 (+ 1207us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 08:59:58.862356 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:01.497689 19104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46718 (request call id 706) took 2656 ms (client timeout 1905 ms). Trace:
W20260204 09:00:01.498072 19104 rpcz_store.cc:269] 0204 08:59:58.841720 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.862082 (+ 20362us) service_pool.cc:225] Handling call
0204 09:00:01.497510 (+2635428us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.499192 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.208628 19100 raft_consensus.cc:1240] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260204 09:00:01.501807 19100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46718 (request call id 698) took 3416 ms. Trace:
I20260204 09:00:01.502133 19100 rpcz_store.cc:276] 0204 08:59:58.085324 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.299304 (+213980us) service_pool.cc:225] Handling call
0204 08:59:58.299588 (+ 284us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:01.500668 (+3201080us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.501377 (+ 709us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b54000055d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.501662 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6689682816}
I20260204 08:59:58.852110 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 09:00:01.082783 18340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 08:59:58.895174 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:00.205804 20224 log.cc:927] Time spent T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 1.398s user 0.003s sys 0.008s
W20260204 08:59:59.272440 20226 log.cc:927] Time spent T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.066s user 0.000s sys 0.001s
I20260204 09:00:01.154103 20245 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.173663 20249 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.503623 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.515584 20249 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.518707 20249 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.211988 20254 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:01.519798 20254 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.522214 20254 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 09:00:01.210534 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 2.36693e+06us
I20260204 09:00:01.275004 18369 raft_consensus.cc:1240] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 09:00:01.522961 19104 raft_consensus.cc:2468] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 09:00:01.281127 18373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 785) took 2834 ms. Trace:
W20260204 09:00:01.284108 18449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47928 (request call id 974) took 3774 ms (client timeout 2839 ms). Trace:
I20260204 09:00:01.285130 18447 raft_consensus.cc:1240] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:01.279373 18371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 287) took 3840 ms. Trace:
W20260204 09:00:01.305783 18520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 665) took 4228 ms (client timeout 2594 ms). Trace:
I20260204 09:00:01.514652 20203 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:01.524768 18491 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:01.307546 18445 raft_consensus.cc:1240] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: []
W20260204 09:00:01.311411 18417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.460s user 0.029s sys 0.050s
I20260204 09:00:01.514108 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 325) took 2866 ms. Trace:
I20260204 09:00:01.514400 20245 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.326333 20257 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:01.327792 19105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46718 (request call id 699) took 3234 ms. Trace:
I20260204 09:00:01.328095 20258 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.333638 18517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 681) took 2904 ms. Trace:
I20260204 09:00:01.335641 19099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 784) took 3583 ms. Trace:
I20260204 09:00:01.353722 18451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 970) took 3908 ms. Trace:
W20260204 09:00:01.362198 18341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.691s user 0.012s sys 0.061s
I20260204 09:00:01.369418 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.369486 20260 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.389376 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.526698 20257 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.528070 20260 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.527130 20263 raft_consensus.cc:2804] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260204 09:00:01.524039 18449 rpcz_store.cc:269] 0204 08:59:57.509624 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.695174 (+185550us) service_pool.cc:225] Handling call
0204 09:00:01.283564 (+3588390us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400624154. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.283859 (+ 295us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":688472448}
W20260204 09:00:01.391881 18524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.622s user 0.037s sys 0.065s
I20260204 09:00:01.529255 20263 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.529749 20263 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:01.392146 20261 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.390493 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:01.523797 18414 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:01.530470 20261 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:01.531193 18525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52184 (request call id 294) took 4012 ms (client timeout 1823 ms). Trace:
I20260204 09:00:01.396921 18518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 682) took 2967 ms. Trace:
I20260204 09:00:01.404491 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 695) took 3837 ms. Trace:
W20260204 09:00:01.529958 18524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.760s user 0.038s sys 0.065s
I20260204 09:00:01.406617 18446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 384) took 3846 ms. Trace:
I20260204 09:00:00.236433 19646 raft_consensus.cc:3055] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:01.120854 19745 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.536343 18451 rpcz_store.cc:276] 0204 08:59:57.444715 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.728680 (+283965us) service_pool.cc:225] Handling call
0204 08:59:58.094929 (+366249us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:58.096270 (+ 1341us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.353064 (+3256794us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54005b81d0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83ee52d 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.353413 (+ 349us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":762806016}
I20260204 09:00:01.537402 19745 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.537765 19099 rpcz_store.cc:276] 0204 08:59:57.752163 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.967226 (+215063us) service_pool.cc:225] Handling call
0204 08:59:58.097623 (+130397us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:58.622106 (+524483us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.335137 (+2713031us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b5400264654. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.335474 (+ 337us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1204877184}
I20260204 09:00:01.538897 19099 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
I20260204 08:59:59.831998 19794 raft_consensus.cc:3055] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:01.540567 19794 raft_consensus.cc:740] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:01.137924 19814 raft_consensus.cc:3055] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:01.542907 19814 raft_consensus.cc:740] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:01.542775 20258 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.544255 19814 consensus_queue.cc:260] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.545147 20258 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.076283 19893 raft_consensus.cc:740] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:01.532985 18446 rpcz_store.cc:276] 0204 08:59:57.559715 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.774391 (+214676us) service_pool.cc:225] Handling call
0204 08:59:57.827793 (+ 53402us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:58.463843 (+636050us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.406055 (+2942212us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540010efd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.406413 (+ 358us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1400436992}
I20260204 09:00:01.535697 19109 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:01.547729 19893 consensus_queue.cc:260] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.209115 19898 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:00.063863 19913 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.526150 18521 rpcz_store.cc:276] 0204 08:59:58.648017 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.648136 (+ 119us) service_pool.cc:225] Handling call
0204 08:59:58.649812 (+ 1676us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 08:59:58.654730 (+ 4918us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:58.654758 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 08:59:58.659910 (+ 5152us) log.cc:844] Serialized 52 byte log entry
0204 08:59:58.694881 (+ 34971us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:58.695159 (+ 278us) log.cc:844] Serialized 14 byte log entry
0204 08:59:58.695322 (+ 163us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:58.695385 (+ 63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:00.205152 (+1509767us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 09:00:01.513499 (+1308347us) raft_consensus.cc:1685] finished
0204 09:00:01.513672 (+ 173us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.513940 (+ 268us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4559,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":5548,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":3560,"spinlock_wait_cycles":8945920,"thread_start_us":7820,"threads_started":1,"wal-append.queue_time_us":121157}
I20260204 09:00:01.554333 19913 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:58.893718 19980 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:01.548441 19109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46718 (request call id 694) took 3464 ms (client timeout 1796 ms). Trace:
I20260204 09:00:01.023291 19985 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:01.558977 19985 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.558737 20189 consensus_queue.cc:1059] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 09:00:01.099176 20079 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.560139 20189 raft_consensus.cc:3055] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:01.560904 20189 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:01.562177 20189 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.530603 20260 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.310732 20102 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 09:00:01.564350 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 61390.1us
I20260204 09:00:01.375583 20140 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.565886 19050 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 08:59:58.871760 19642 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:01.567754 19898 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.569757 19101 raft_consensus.cc:1240] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 3. Current term is 4. Ops: []
I20260204 08:59:58.887912 19781 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:01.075721 19963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.280s user 0.018s sys 0.018s
W20260204 09:00:01.581156 19963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.785s user 0.020s sys 0.019s
I20260204 09:00:01.325552 19964 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.317870 20126 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.584471 20126 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:59.274734 19983 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:01.319746 19993 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.317131 20130 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 08:59:58.861030 20006 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:01.588905 20130 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.121505 20082 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.590939 20082 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:00.247094 20129 raft_consensus.cc:3055] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 09:00:01.407753 19988 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 08:59:59.901909 20135 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.594770 20135 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:58.880206 20154 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 08:59:58.907843 20159 log.cc:927] Time spent T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 1.396s user 0.005s sys 0.007s
I20260204 08:59:59.706961 20174 raft_consensus.cc:3055] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:01.600580 20174 raft_consensus.cc:740] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:01.601999 20174 consensus_queue.cc:260] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.603181 20174 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
W20260204 09:00:01.149127 20182 log.cc:927] Time spent T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 2.918s user 0.003s sys 0.017s
I20260204 09:00:00.086253 20184 raft_consensus.cc:3055] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:00:01.610584 20184 raft_consensus.cc:740] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:01.610816 19993 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.610441 20130 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 08:59:58.899178 20191 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:01.620050 19913 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.312968 20192 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.628638 20192 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 08:59:58.882541 20194 raft_consensus.cc:3055] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:01.630909 18196 catalog_manager.cc:5654] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:01.632130 20194 raft_consensus.cc:740] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:01.633394 20194 consensus_queue.cc:260] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.634585 20194 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.633946 18196 catalog_manager.cc:5654] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 4 to 6, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 6 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:01.207083 20181 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:01.635754 18196 catalog_manager.cc:5654] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:01.636715 20181 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.638957 20181 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.638478 18196 catalog_manager.cc:5654] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 2 to 4, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } }
I20260204 08:59:58.892751 20195 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:58.888711 20196 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.311754 20206 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 09:00:01.642407 18340 connection.cc:232] RPC call timeout handler was delayed by -2.0932962310000676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260204 09:00:01.642684 20206 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.642264 20195 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 08:59:58.868145 20202 consensus_queue.cc:260] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 08:59:58.896049 20207 consensus_queue.cc:237] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:01.338534 20219 log.cc:927] Time spent T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 2.489s user 0.018s sys 0.025s
I20260204 09:00:01.440941 18516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 683) took 3944 ms. Trace:
I20260204 09:00:01.659801 18516 rpcz_store.cc:276] 0204 08:59:57.495987 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.500073 (+ 4086us) service_pool.cc:225] Handling call
0204 09:00:01.151449 (+3651376us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 09:00:01.203016 (+ 51567us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:01.440327 (+237311us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.440764 (+ 437us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10318208}
I20260204 09:00:01.660499 20202 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.662022 18516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 330) took 3009 ms. Trace:
I20260204 09:00:01.662376 18516 rpcz_store.cc:276] 0204 08:59:58.652960 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.660917 (+3007957us) service_pool.cc:225] Handling call
0204 09:00:01.661359 (+ 442us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.661654 (+ 295us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:01.661681 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:01.661728 (+ 47us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:01.661757 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.661817 (+ 60us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.661950 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.444209 20264 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.663861 20264 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.445040 20262 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:01.453693 19107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46718 (request call id 703) took 3217 ms. Trace:
W20260204 09:00:01.456833 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 2.60873e+06us
I20260204 09:00:01.458494 18370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 297) took 3888 ms. Trace:
I20260204 09:00:01.464681 20265 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.525873 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:01.528743 18369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 778) took 3102 ms. Trace:
W20260204 09:00:01.526046 18417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.675s user 0.030s sys 0.050s
I20260204 09:00:01.525485 18447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 716) took 3003 ms. Trace:
I20260204 09:00:01.524132 18371 rpcz_store.cc:276] 0204 08:59:57.438947 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.440753 (+ 1806us) service_pool.cc:225] Handling call
0204 08:59:57.562384 (+121631us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:57.620405 (+ 58021us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.278703 (+3658298us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54003881d0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83ee52d 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.279045 (+ 342us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":182347520}
I20260204 09:00:01.534760 20261 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.527320 18445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 971) took 4081 ms. Trace:
I20260204 09:00:01.308383 19660 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.668898 20265 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.535239 20245 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.530246 20257 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.532730 18414 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:01.669750 19660 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:01.670784 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 138297us
I20260204 09:00:01.671244 20265 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.671679 18414 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:01.673307 18414 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:01.539601 19099 raft_consensus.cc:606] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:01.541795 18518 rpcz_store.cc:276] 0204 08:59:58.429202 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.431775 (+ 2573us) service_pool.cc:225] Handling call
0204 08:59:58.432020 (+ 245us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:58.568254 (+136234us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.396272 (+2828018us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b54002f6554. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.396718 (+ 446us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":212013952}
I20260204 09:00:01.526494 19105 rpcz_store.cc:276] 0204 08:59:58.093043 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.308645 (+215602us) service_pool.cc:225] Handling call
0204 08:59:58.308940 (+ 295us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:58.506513 (+197573us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.327037 (+2820524us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54000041d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.327426 (+ 389us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":391542016}
W20260204 09:00:01.524405 18520 rpcz_store.cc:269] 0204 08:59:57.077114 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.077239 (+ 125us) service_pool.cc:225] Handling call
0204 09:00:01.305138 (+4227899us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400214154. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.305467 (+ 329us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1618382080}
I20260204 09:00:01.541944 19794 consensus_queue.cc:260] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.532214 18523 rpcz_store.cc:276] 0204 08:59:57.567274 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.774826 (+207552us) service_pool.cc:225] Handling call
0204 08:59:57.791984 (+ 17158us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:57.855075 (+ 63091us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.404068 (+3548993us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5400703ad0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83ee52d 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.404320 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":38866176}
I20260204 09:00:01.545449 19814 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.675752 19099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41020 (request call id 4) took 2828 ms. Trace:
I20260204 09:00:01.678215 19099 rpcz_store.cc:276] 0204 08:59:58.846840 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.538710 (+2691870us) service_pool.cc:225] Handling call
0204 09:00:01.675636 (+136926us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.679868 19660 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.681156 18516 raft_consensus.cc:1240] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:01.681906 18516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 331) took 3028 ms. Trace:
I20260204 09:00:01.682248 18516 rpcz_store.cc:276] 0204 08:59:58.653170 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.680445 (+3027275us) service_pool.cc:225] Handling call
0204 09:00:01.680889 (+ 444us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.681639 (+ 750us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.681848 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 09:00:01.531659 18525 rpcz_store.cc:269] 0204 08:59:57.519012 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.519109 (+ 97us) service_pool.cc:225] Handling call
0204 09:00:01.390145 (+3871036us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:01.531114 (+140969us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6356864}
I20260204 09:00:01.551776 19893 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.667513 18369 rpcz_store.cc:276] 0204 08:59:58.426043 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.430802 (+ 4759us) service_pool.cc:225] Handling call
0204 08:59:58.435899 (+ 5097us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.523145 (+3087246us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.528431 (+ 5286us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b5400378f54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.528684 (+ 253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6527947008}
I20260204 09:00:01.679351 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.684417 19099 raft_consensus.cc:2393] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:01.552098 19646 raft_consensus.cc:740] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:01.676671 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.686502 19646 consensus_queue.cc:260] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.526921 18517 rpcz_store.cc:276] 0204 08:59:58.428941 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.438920 (+ 9979us) service_pool.cc:225] Handling call
0204 08:59:58.439231 (+ 311us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:58.604916 (+165685us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.333061 (+2728145us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b5400338954. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.333432 (+ 371us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":186360704}
I20260204 09:00:01.514963 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 327) took 2866 ms. Trace:
W20260204 09:00:01.536181 18341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.865s user 0.013s sys 0.061s
I20260204 09:00:01.523813 18373 rpcz_store.cc:276] 0204 08:59:58.446826 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.562796 (+115970us) service_pool.cc:225] Handling call
0204 08:59:58.587146 (+ 24350us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:58.646760 (+ 59614us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:58.646818 (+ 58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 08:59:58.646878 (+ 60us) raft_consensus.cc:1645] Marking committed up to 4
0204 08:59:58.646920 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.280555 (+2633635us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b54004d71d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.280648 (+ 93us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.280925 (+ 277us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":136604416}
I20260204 09:00:01.524973 20203 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.676663 18414 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:01.688503 19794 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.689877 19963 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:01.690279 20203 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.692073 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:01.557090 19109 rpcz_store.cc:269] 0204 08:59:58.084306 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.084404 (+ 98us) service_pool.cc:225] Handling call
0204 09:00:01.368908 (+3284504us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:01.548381 (+179473us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20544256}
I20260204 09:00:01.693565 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.693765 18371 raft_consensus.cc:1240] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:01.694065 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:01.145315 20169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.343s user 0.016s sys 0.011s
I20260204 09:00:01.539601 19745 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.572614 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.692862 18369 raft_consensus.cc:1240] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:01.699707 19106 raft_consensus.cc:2393] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 7: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
W20260204 09:00:01.699141 20169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.897s user 0.016s sys 0.013s
I20260204 09:00:01.572875 19101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46704 (request call id 816) took 3816 ms. Trace:
I20260204 09:00:01.573671 20189 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:01.516258 19100 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 09:00:01.578912 19050 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 09:00:01.704484 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 125780us
I20260204 09:00:01.705261 19050 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:01.576913 19781 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.582373 19964 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.706305 19050 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:01.693660 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:01.564663 20102 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.707629 19964 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.593096 20129 raft_consensus.cc:740] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:01.708209 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:01.709177 20245 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:01.708940 20129 consensus_queue.cc:260] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.709609 20245 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.605096 20126 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.699076 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:01.710791 19913 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 09:00:01.603739 19898 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.605352 20135 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.620527 19973 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.603318 19952 raft_consensus.cc:3055] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:00:01.621023 19102 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:01.710299 20129 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
W20260204 09:00:01.700943 18341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.708993 20102 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.624707 20082 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.625649 19108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 764) took 4321 ms. Trace:
I20260204 09:00:01.308609 20193 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.621064 20184 consensus_queue.cc:260] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 08:59:58.861153 20198 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:01.676715 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.721166 20198 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 09:00:00.158303 20215 log.cc:927] Time spent T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 1.525s user 0.008s sys 0.009s
I20260204 09:00:01.713042 19646 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:01.725095 18519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 687) took 3294 ms. Trace:
I20260204 09:00:01.725493 18519 rpcz_store.cc:276] 0204 08:59:58.430504 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.464686 (+ 34182us) service_pool.cc:225] Handling call
0204 08:59:58.465055 (+ 369us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:58.465289 (+ 234us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:58.465321 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:58.511859 (+ 46538us) log.cc:844] Serialized 26 byte log entry
0204 08:59:58.626772 (+114913us) raft_consensus.cc:1645] Marking committed up to 2
0204 08:59:58.631292 (+ 4520us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:58.635605 (+ 4313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:00.157664 (+1522059us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 09:00:01.724604 (+1566940us) raft_consensus.cc:1685] finished
0204 09:00:01.724644 (+ 40us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.724928 (+ 284us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3068672,"thread_start_us":69273,"threads_started":1,"wal-append.queue_time_us":100713}
I20260204 09:00:01.727262 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:01.735745 18519 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:01.736338 18197 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48004 (request call id 208) took 9907 ms. Trace:
I20260204 09:00:01.642984 18442 raft_consensus.cc:2410] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260204 09:00:01.645175 20196 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.646798 20206 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.651492 19993 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.715956 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:01.741009 18442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47928 (request call id 981) took 3525 ms (client timeout 2643 ms). Trace:
I20260204 09:00:01.710805 19101 rpcz_store.cc:276] 0204 08:59:57.756000 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.982570 (+226570us) service_pool.cc:225] Handling call
0204 09:00:01.363326 (+3380756us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b5800003098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 09:00:01.363812 (+ 486us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.570143 (+206331us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.572632 (+ 2489us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54000087d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.572815 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":492264576}
W20260204 09:00:01.741413 18442 rpcz_store.cc:269] 0204 08:59:58.215976 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.234935 (+ 18959us) service_pool.cc:225] Handling call
0204 08:59:58.895019 (+660084us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b58004a1098. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb53040dc 00007fceb5303c9b 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:01.740773 (+2845754us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540016fb54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.740920 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":325674112}
I20260204 09:00:01.721618 20198 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.631011 20192 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.642292 20263 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:01.655412 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.655819 20080 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.749984 20080 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.751044 20263 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.642256 19985 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.648339 18196 catalog_manager.cc:5654] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:01.665608 19107 rpcz_store.cc:276] 0204 08:59:58.236397 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.613491 (+377094us) service_pool.cc:225] Handling call
0204 08:59:58.613830 (+ 339us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 08:59:58.759224 (+145394us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.453158 (+2693934us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400004bd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.453525 (+ 367us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":333239040}
I20260204 09:00:01.753095 19985 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.665917 18370 rpcz_store.cc:276] 0204 08:59:57.569735 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.569858 (+ 123us) service_pool.cc:225] Handling call
0204 08:59:57.570143 (+ 285us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:00.251164 (+2681021us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b580045f8d0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb834b0da 00007fceb83cd177 00007fceb83e5c67 00007fceb83e745e 00007fceb83f17c9 00007fceb83f2096 00007fceb83eea0f 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34
0204 09:00:01.456874 (+1205710us) raft_consensus.cc:1534] Early marking committed up to index 2
0204 09:00:01.456932 (+ 58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:01.457827 (+ 895us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:01.457860 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.458098 (+ 238us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.458350 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":674,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":292,"spinlock_wait_cycles":3510552960}
I20260204 09:00:01.753798 19107 raft_consensus.cc:1240] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:01.754192 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.754455 19107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 796) took 3316 ms. Trace:
W20260204 09:00:01.673535 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 2.82692e+06us
I20260204 09:00:01.673408 20265 consensus_queue.cc:1059] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 09:00:01.674120 20191 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:01.533221 20230 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:01.755167 20207 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.755687 20206 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.754786 19107 rpcz_store.cc:276] 0204 08:59:58.437998 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.753212 (+3315214us) service_pool.cc:225] Handling call
0204 09:00:01.753596 (+ 384us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.754197 (+ 601us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.754387 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.756233 20206 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.668092 18445 rpcz_store.cc:276] 0204 08:59:57.445430 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.729551 (+284121us) service_pool.cc:225] Handling call
0204 09:00:01.287198 (+3557647us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.526493 (+239295us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.527089 (+ 596us) spinlock_profiling.cc:243] Waited 3.56 s on lock 0x7b54005efbd0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83ee52d 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.527254 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8181148544}
I20260204 09:00:01.756937 20174 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.675606 19965 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:01.755812 20207 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.757525 20174 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.758621 20102 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.759197 20206 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.759138 20102 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.759769 20206 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.760257 20206 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.760891 20265 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.761487 20265 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.762176 20206 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.759235 20207 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.764380 19985 consensus_queue.cc:1059] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:01.759354 20174 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.765564 19985 raft_consensus.cc:3055] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 09:00:01.763378 20265 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.765960 19985 raft_consensus.cc:740] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 09:00:01.643050 18340 connection.cc:232] RPC call timeout handler was delayed by -1.4075339830000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260204 09:00:01.686954 19104 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 09:00:01.693466 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:01.694756 19109 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
W20260204 09:00:01.563863 18521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 694) took 2721 ms (client timeout 2594 ms). Trace:
I20260204 09:00:01.696030 18375 raft_consensus.cc:1240] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.565733 20140 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.696887 18373 raft_consensus.cc:1240] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.697422 20081 consensus_queue.cc:1059] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 09:00:01.769290 19102 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 8.
I20260204 09:00:01.769467 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.769726 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.770422 19104 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:01.770866 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.757691 18196 catalog_manager.cc:5654] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 2 to 4, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:01.697659 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:01.687598 18522 rpcz_store.cc:276] 0204 08:59:58.648699 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.758276 (+109577us) service_pool.cc:225] Handling call
0204 08:59:58.758629 (+ 353us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:58.758950 (+ 321us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:58.758979 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:58.759378 (+ 399us) log.cc:844] Serialized 26 byte log entry
0204 08:59:58.850080 (+ 90702us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:58.860440 (+ 10360us) log.cc:844] Serialized 14 byte log entry
0204 08:59:58.867474 (+ 7034us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:58.867553 (+ 79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:01.514508 (+2646955us) raft_consensus.cc:1685] finished
0204 09:00:01.514545 (+ 37us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.514793 (+ 248us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7108,"prepare.queue_time_us":8257,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":8549,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":8386,"spinlock_wait_cycles":85248,"thread_start_us":90362,"threads_started":1,"wal-append.queue_time_us":108523}
I20260204 09:00:01.771610 20140 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.768388 19109 raft_consensus.cc:606] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:01.772183 18525 raft_consensus.cc:2393] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:01.772596 18522 raft_consensus.cc:1240] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
W20260204 09:00:01.760365 18488 connection.cc:232] RPC call timeout handler was delayed by -1.9690037740000434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260204 09:00:01.769152 18521 rpcz_store.cc:269] 0204 08:59:58.842432 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.563572 (+2721140us) service_pool.cc:212] Skipping call since client already timed out
0204 09:00:01.563765 (+ 193us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260204 09:00:01.773396 18488 connection.cc:232] RPC call timeout handler was delayed by -1.7712227109999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2839s for a response
I20260204 09:00:01.710067 20245 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:01.767416 20263 raft_consensus.cc:3055] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:01.774211 20263 raft_consensus.cc:740] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:01.774650 18521 raft_consensus.cc:1275] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:01.695286 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:01.721666 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.677178 20078 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260204 09:00:01.773799 18488 connection.cc:232] RPC call timeout handler was delayed by -1.5730037739999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260204 09:00:01.700956 19106 raft_consensus.cc:1240] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.775197 20263 consensus_queue.cc:260] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.720355 18372 raft_consensus.cc:1240] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260204 09:00:01.712675 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.777022 20263 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:01.777347 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.712113 19952 raft_consensus.cc:740] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 09:00:01.776065 18488 connection.cc:232] RPC call timeout handler was delayed by -1.1086037740000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2643s for a response
I20260204 09:00:01.779261 19952 consensus_queue.cc:260] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.779970 19105 raft_consensus.cc:2393] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:01.768965 18374 raft_consensus.cc:2393] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:01.711617 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:01.713896 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:01.718293 20257 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.729378 20135 consensus_queue.cc:1059] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:01.790613 18374 raft_consensus.cc:1240] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.790968 20135 raft_consensus.cc:3055] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:00:01.718446 20184 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:01.711977 19973 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.790648 20257 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.791777 18343 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:01.793356 19973 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.715968 20082 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.793711 20192 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:01.718430 19745 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:01.794004 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:01.794090 20082 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.793268 20257 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.794407 19745 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.796164 20082 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.715274 19988 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.796883 19745 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.709627 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:01.797079 19988 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.718936 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.796111 19105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 797) took 3333 ms. Trace:
I20260204 09:00:01.716084 19108 rpcz_store.cc:276] 0204 08:59:57.304171 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:57.304305 (+ 134us) service_pool.cc:225] Handling call
0204 08:59:57.304621 (+ 316us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 08:59:57.311156 (+ 6535us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:57.311184 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 08:59:57.322574 (+ 11390us) log.cc:844] Serialized 26 byte log entry
0204 08:59:57.447868 (+125294us) raft_consensus.cc:1645] Marking committed up to 3
0204 08:59:57.447914 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 08:59:57.447987 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 08:59:58.907292 (+1459305us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 09:00:01.625140 (+2717848us) raft_consensus.cc:1685] finished
0204 09:00:01.625176 (+ 36us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.625476 (+ 300us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8045,"raft.queue_time_us":6777,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":20181376,"thread_start_us":117997,"threads_started":1,"wal-append.queue_time_us":187163}
I20260204 09:00:01.717878 20193 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.799094 19988 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:01.716317 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.799808 20193 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.667698 18447 rpcz_store.cc:276] 0204 08:59:58.522103 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.522203 (+ 100us) service_pool.cc:225] Handling call
0204 09:00:01.284581 (+2762378us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.524269 (+239688us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.525258 (+ 989us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b5400624150. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83ee52d 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.525421 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6351954816}
I20260204 09:00:01.756682 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:01.800870 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.801043 19107 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "93c6901415594017879443427a92d4c9"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
from {username='slave'} at 127.0.0.1:41020
I20260204 09:00:01.770000 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.773123 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:01.779538 18488 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 09:00:01.781370 18340 connection.cc:232] RPC call timeout handler was delayed by -1.3787339830000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260204 09:00:01.728127 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.776026 18445 raft_consensus.cc:1275] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 09:00:01.773816 18522 raft_consensus.cc:1240] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:01.798432 19105 rpcz_store.cc:276] 0204 08:59:58.448816 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.780582 (+3331766us) service_pool.cc:225] Handling call
0204 09:00:01.780878 (+ 296us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.782381 (+ 1503us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:01.782405 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:01.782443 (+ 38us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:01.782468 (+ 25us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.782520 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.782621 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 09:00:01.722887 20181 consensus_queue.cc:1175] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260204 09:00:01.685388 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.688009 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:01.773131 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.786026 18372 raft_consensus.cc:1240] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.779524 18491 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:01.791081 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:01.669584 20264 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.776492 19106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46704 (request call id 820) took 3404 ms. Trace:
I20260204 09:00:01.798295 18377 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 09:00:01.782099 18525 raft_consensus.cc:1240] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:01.806021 19107 raft_consensus.cc:606] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Received request to transfer leadership to TS 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:01.805688 19106 rpcz_store.cc:276] 0204 08:59:58.372433 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.700358 (+3327925us) service_pool.cc:225] Handling call
0204 09:00:01.700777 (+ 419us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.776234 (+ 75457us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.776422 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260204 09:00:01.806849 18414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.780696 19952 raft_consensus.cc:3060] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:01.803056 19099 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 09:00:01.806994 19107 raft_consensus.cc:614] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 09:00:01.773757 20126 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election won for term 4
I20260204 09:00:01.761129 20102 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.794094 20192 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:01.756861 20080 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.771337 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:01.822108 19109 raft_consensus.cc:1240] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260204 09:00:01.822145 20102 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:01.822811 20102 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:01.822978 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.823712 19104 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:01.824852 20230 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.825596 19963 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.825440 20230 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.826102 19963 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.827661 20102 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.827970 20191 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.802377 18196 catalog_manager.cc:5654] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 3 to 5, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 5 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 09:00:01.826181 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:01.770890 19102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46720 (request call id 799) took 3107 ms (client timeout 2076 ms). Trace:
I20260204 09:00:01.794968 20135 raft_consensus.cc:740] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:01.821295 19107 raft_consensus.cc:1240] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:01.833658 18371 raft_consensus.cc:1275] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:01.833861 20126 raft_consensus.cc:697] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:01.834200 19107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46718 (request call id 707) took 2988 ms. Trace:
I20260204 09:00:01.820107 20192 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
W20260204 09:00:01.821838 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.835444 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:01.834594 19107 rpcz_store.cc:276] 0204 08:59:58.846015 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.819781 (+2973766us) service_pool.cc:225] Handling call
0204 09:00:01.820146 (+ 365us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.833948 (+ 13802us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.834123 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.836380 19107 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
I20260204 09:00:01.836930 19107 raft_consensus.cc:606] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:01.837697 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 328) took 3188 ms. Trace:
W20260204 09:00:01.838516 18489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:01.825443 18417 connection.cc:232] RPC call timeout handler was delayed by -2.0645755780000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260204 09:00:01.840363 18417 connection.cc:232] RPC call timeout handler was delayed by -1.9340755780000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260204 09:00:01.827857 19781 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.840461 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260204 09:00:01.830719 20080 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.841099 19781 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:01.833518 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.835520 20135 consensus_queue.cc:260] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.844446 18375 raft_consensus.cc:1240] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260204 09:00:01.844903 20135 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
W20260204 09:00:01.845165 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 66123.3us
I20260204 09:00:01.845548 19109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46704 (request call id 822) took 3172 ms. Trace:
I20260204 09:00:01.845906 19109 rpcz_store.cc:276] 0204 08:59:58.658444 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.811870 (+3153426us) service_pool.cc:225] Handling call
0204 09:00:01.821873 (+ 10003us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 09:00:01.831072 (+ 9199us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.831260 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.846312 18491 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:01.840039 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.847224 19108 raft_consensus.cc:2393] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 7: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:01.830243 20191 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.823741 20181 raft_consensus.cc:3055] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:00:01.847971 18491 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:01.848793 20140 raft_consensus.cc:2749] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 09:00:01.849124 20191 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.849448 20140 consensus_queue.cc:1059] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:01.841236 20080 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.850606 20140 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:01.850980 20140 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:01.851300 20140 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.848085 18196 catalog_manager.cc:5654] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 reported cstate change: term changed from 3 to 5, leader changed from 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 5 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } }
I20260204 09:00:01.815703 20193 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.851598 20080 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.852108 20265 raft_consensus.cc:3055] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:00:01.852559 20265 raft_consensus.cc:740] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:01.853397 20265 consensus_queue.cc:260] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.854624 20265 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:01.847028 20198 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.814111 18516 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:01.851795 20264 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:01.833205 19963 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.840154 20230 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.834813 20126 consensus_queue.cc:237] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.843408 19781 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.850731 19099 raft_consensus.cc:1240] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.812548 18369 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 09:00:01.835999 18343 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:01.847988 20181 raft_consensus.cc:740] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:01.876929 19745 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:01.876797 20181 consensus_queue.cc:260] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:01.877373 19745 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:01.877729 19745 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:01.877837 20181 raft_consensus.cc:3060] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:01.857844 20198 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 09:00:01.859305 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.883210 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.884127 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.884755 18516 raft_consensus.cc:1275] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:01.885171 18446 raft_consensus.cc:1275] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260204 09:00:01.860610 18417 connection.cc:232] RPC call timeout handler was delayed by -1.4006979380000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260204 09:00:01.860723 20078 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:01.861872 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:01.887027 19108 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:01.886957 20078 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.888142 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.888952 18450 raft_consensus.cc:2410] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:01.889016 20078 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.878185 20189 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.887472 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.890105 18449 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:01.889968 20189 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.891848 20189 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:01.863511 20193 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.892176 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:01.892724 18449 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.893070 18443 raft_consensus.cc:2410] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260204 09:00:01.893545 20193 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.859760 20264 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.894658 20264 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:01.894465 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:01.895984 20078 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.896485 20078 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.871308 18370 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 09:00:01.872500 18447 raft_consensus.cc:1275] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:01.868918 19107 raft_consensus.cc:1240] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:01.894578 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.868372 19099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46704 (request call id 825) took 3209 ms. Trace:
I20260204 09:00:01.873528 18375 raft_consensus.cc:1240] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.898877 19099 rpcz_store.cc:276] 0204 08:59:58.659228 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.820329 (+3161101us) service_pool.cc:225] Handling call
0204 09:00:01.850556 (+ 30227us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.868104 (+ 17548us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.868298 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.856132 19106 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:01.899459 18488 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:01.861210 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.896025 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:01.873242 18377 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:01.871392 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:01.896519 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:01.872113 19105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 798) took 3264 ms. Trace:
I20260204 09:00:01.895574 18417 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:01.904191 19105 rpcz_store.cc:276] 0204 08:59:58.607426 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.802430 (+3195004us) service_pool.cc:225] Handling call
0204 09:00:01.831843 (+ 29413us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.870484 (+ 38641us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:01.870509 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:01.870553 (+ 44us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:01.871915 (+ 1362us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.871972 (+ 57us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.872067 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.909142 19106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46704 (request call id 824) took 3250 ms. Trace:
W20260204 09:00:01.878257 18340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.3.195:40161 timed out after 1.889s (SENT) [suppressed 8 similar messages]
I20260204 09:00:01.861516 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 09:00:01.909970 19106 rpcz_store.cc:276] 0204 08:59:58.658980 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.807292 (+3148312us) service_pool.cc:225] Handling call
0204 09:00:01.855968 (+ 48676us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.908905 (+ 52937us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.909092 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:01.905190 19108 raft_consensus.cc:2468] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 09:00:01.912281 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.913511 19109 raft_consensus.cc:2393] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:01.915912 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.916121 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.916358 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.870082 19794 consensus_queue.cc:1059] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260204 09:00:01.917070 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.917564 18451 raft_consensus.cc:1275] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:01.917886 19794 raft_consensus.cc:3055] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 LEADER]: Stepping down as leader of term 7
I20260204 09:00:01.918228 19794 raft_consensus.cc:740] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:01.917078 18445 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 09:00:01.915944 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.911934 20258 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:01.767424 19985 consensus_queue.cc:260] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.918241 19109 raft_consensus.cc:1275] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:01.830451 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.922284 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.923055 18377 raft_consensus.cc:1275] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260204 09:00:01.924553 19108 raft_consensus.cc:1240] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.921725 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.926442 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.926707 19107 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 09:00:01.928333 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.928720 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.928887 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.929774 18373 raft_consensus.cc:2393] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 3: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:01.930466 18417 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:01.925297 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:01.919623 19660 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 09:00:01.931548 18450 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:01.931345 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.925745 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.931574 19105 raft_consensus.cc:1240] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.928946 18448 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:01.933993 19105 raft_consensus.cc:1240] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
W20260204 09:00:01.935433 19050 connection.cc:232] RPC call timeout handler was delayed by -2.9289329570000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260204 09:00:01.932904 18375 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:01.875694 20245 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.932734 19985 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:01.937357 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.936203 19109 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:01.938097 18451 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 09:00:01.938616 19109 raft_consensus.cc:3055] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:01.932834 18442 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:01.904717 20198 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.838048 18524 rpcz_store.cc:276] 0204 08:59:58.648931 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.768145 (+119214us) service_pool.cc:225] Handling call
0204 08:59:58.768492 (+ 347us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 08:59:58.768859 (+ 367us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 08:59:58.768888 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 08:59:58.769433 (+ 545us) log.cc:844] Serialized 52 byte log entry
0204 09:00:01.532649 (+2763216us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:01.579694 (+ 47045us) log.cc:844] Serialized 14 byte log entry
0204 09:00:01.825427 (+245733us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b18000848e0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fcebe19dc91 00007fcebe1aa671 00007fceb5341402 00007fceb53436a1 00007fceb5343659 00007fceb53435e9 00007fceb53435b1 00007fceb53428ad 0000000000379254 0000000000379099 00007fceb532469a
0204 09:00:01.829571 (+ 4144us) log.cc:844] Serialized 14 byte log entry
0204 09:00:01.829750 (+ 179us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.837338 (+ 7588us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:01.837478 (+ 140us) raft_consensus.cc:1685] finished
0204 09:00:01.837493 (+ 15us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.837628 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22467,"prepare.queue_time_us":51006,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":15454,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":36218,"spinlock_wait_cycles":5721984,"thread_start_us":3034107,"threads_started":3,"wal-append.queue_time_us":726466,"wal-append.run_cpu_time_us":1888,"wal-append.run_wall_time_us":1060553}
I20260204 09:00:01.873986 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:01.937358 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.940297 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.736685 18197 rpcz_store.cc:276] 0204 08:59:51.828928 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:51.831771 (+ 2843us) service_pool.cc:225] Handling call
0204 09:00:01.736141 (+9904370us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 08:59:56.108759 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 08:59:56.109352 (+ 593us) write_op.cc:432] Acquiring schema lock in shared mode
0204 08:59:56.109386 (+ 34us) write_op.cc:435] Acquired schema lock
0204 08:59:56.109403 (+ 17us) tablet.cc:660] Decoding operations
0204 08:59:56.110654 (+ 1251us) write_op.cc:620] Acquiring the partition lock for write op
0204 08:59:56.110737 (+ 83us) write_op.cc:641] Partition lock acquired for write op
0204 08:59:56.110766 (+ 29us) tablet.cc:683] Acquiring locks for 15 operations
0204 08:59:56.294480 (+183714us) tablet.cc:699] Row locks acquired
0204 08:59:56.294501 (+ 21us) write_op.cc:260] PREPARE: finished
0204 08:59:57.326886 (+1032385us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b2c00001db8. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb6ced9b1 00007fceb6cfc67a 00007fceb6cfc303 00007fceb6cfc2a1 00007fceb842a752 00007fceb842a52d 00007fcebbe2f193 00007fcebbe2eca8 00007fcebbe33941 00007fcebbe338f9 00007fcebbe33889
0204 08:59:57.326968 (+ 82us) write_op.cc:270] Start()
0204 08:59:57.327173 (+ 205us) write_op.cc:276] Timestamp: P: 1770195596676751 usec, L: 0
0204 08:59:57.327219 (+ 46us) op_driver.cc:348] REPLICATION: starting
0204 08:59:57.336539 (+ 9320us) log.cc:844] Serialized 5929 byte log entry
0204 08:59:58.284228 (+947689us) op_driver.cc:464] REPLICATION: finished
0204 08:59:58.606747 (+322519us) write_op.cc:301] APPLY: starting
0204 08:59:58.621928 (+ 15181us) tablet.cc:1365] starting BulkCheckPresence
0204 08:59:58.662769 (+ 40841us) tablet.cc:1368] finished BulkCheckPresence
0204 08:59:58.665161 (+ 2392us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 08:59:58.697404 (+ 32243us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 08:59:58.753042 (+ 55638us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0204 08:59:58.753089 (+ 47us) write_op.cc:312] APPLY: finished
0204 08:59:58.753443 (+ 354us) log.cc:844] Serialized 107 byte log entry
0204 08:59:58.753610 (+ 167us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:58.753782 (+ 172us) write_op.cc:454] Released schema lock
0204 08:59:58.753838 (+ 56us) write_op.cc:341] FINISH: Updating metrics
0204 08:59:58.754174 (+ 336us) write_op.cc:489] Releasing partition, row and schema locks
0204 08:59:58.754200 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":734114,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":287305,"apply.run_cpu_time_us":4456,"apply.run_wall_time_us":164322,"num_ops":15,"prepare.queue_time_us":525137,"prepare.run_cpu_time_us":43624,"prepare.run_wall_time_us":1384156,"raft.queue_time_us":507444,"raft.run_cpu_time_us":21709,"raft.run_wall_time_us":221585,"replication_time_us":947914,"spinlock_wait_cycles":878811008,"thread_start_us":1140251,"threads_started":4,"wal-append.queue_time_us":262794,"wal-append.run_cpu_time_us":14860,"wal-append.run_wall_time_us":2193731}]]}
I20260204 09:00:01.939625 19109 raft_consensus.cc:740] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:01.943377 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.938817 19101 raft_consensus.cc:1240] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 5. Current term is 6. Ops: []
W20260204 09:00:01.830866 19102 rpcz_store.cc:269] 0204 08:59:58.663004 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:58.839587 (+176583us) service_pool.cc:225] Handling call
0204 09:00:01.770715 (+2931128us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400007dd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:01.770829 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":265893760}
I20260204 09:00:01.946576 19781 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:01.947101 19781 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.948756 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.949137 19781 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.943493 19107 raft_consensus.cc:1240] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:01.951396 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:01.942667 19050 connection.cc:232] RPC call timeout handler was delayed by -2.844332957000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260204 09:00:01.952076 19050 connection.cc:232] RPC call timeout handler was delayed by -2.8065329570000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260204 09:00:01.951982 18448 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
W20260204 09:00:01.952484 19050 connection.cc:232] RPC call timeout handler was delayed by -2.7948329570000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260204 09:00:01.952771 19050 connection.cc:232] RPC call timeout handler was delayed by -2.6670329570000604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260204 09:00:01.953027 19050 connection.cc:232] RPC call timeout handler was delayed by -2.5575302149999288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260204 09:00:01.953218 19050 connection.cc:232] RPC call timeout handler was delayed by -2.5518329569999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260204 09:00:01.953413 19050 connection.cc:232] RPC call timeout handler was delayed by -2.4141329569999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260204 09:00:01.953601 19050 connection.cc:232] RPC call timeout handler was delayed by -2.3853329570000597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260204 09:00:01.953788 19050 connection.cc:232] RPC call timeout handler was delayed by -2.3232329570000729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260204 09:00:01.953980 19050 connection.cc:232] RPC call timeout handler was delayed by -1.870020858000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260204 09:00:01.954167 19050 connection.cc:232] RPC call timeout handler was delayed by -1.3795208580000917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260204 09:00:01.945454 19106 raft_consensus.cc:1240] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 3. Current term is 4. Ops: []
I20260204 09:00:01.855618 20102 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.946292 20191 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:01.956991 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.946514 19794 consensus_queue.cc:260] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.957033 20082 consensus_queue.cc:1059] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260204 09:00:01.958635 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.958820 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.959200 20082 raft_consensus.cc:3055] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:01.959609 20082 raft_consensus.cc:740] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:01.960464 20082 consensus_queue.cc:260] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.961570 20082 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:01.954631 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.914263 19952 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:01.965480 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 09:00:01.950719 18414 connection.cc:232] RPC call timeout handler was delayed by -1.1504181860000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260204 09:00:01.931329 19745 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.955870 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:01.955998 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 56636.2us
I20260204 09:00:01.958220 19794 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:01.961457 19101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 795) took 3523 ms. Trace:
W20260204 09:00:01.964386 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 86153.4us
I20260204 09:00:01.963233 19100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 794) took 3525 ms. Trace:
I20260204 09:00:01.965471 18450 raft_consensus.cc:1275] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260204 09:00:01.873930 20192 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:01.966552 18414 connection.cc:232] RPC call timeout handler was delayed by -1.1072181860000683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260204 09:00:01.941643 20181 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:01.955915 19109 consensus_queue.cc:260] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.967626 18449 raft_consensus.cc:2468] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
W20260204 09:00:01.968214 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.969728 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:01.950373 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:01.973502 19109 raft_consensus.cc:3060] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:01.974030 19099 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:01.974923 18443 raft_consensus.cc:2393] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 3: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
W20260204 09:00:01.975194 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:01.950130 20198 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:01.968534 20140 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:01.971729 19100 rpcz_store.cc:276] 0204 08:59:58.437480 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.704050 (+3266570us) service_pool.cc:225] Handling call
0204 09:00:01.704436 (+ 386us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 09:00:01.704790 (+ 354us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:01.704834 (+ 44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 09:00:01.705431 (+ 597us) log.cc:844] Serialized 52 byte log entry
0204 09:00:01.909359 (+203928us) raft_consensus.cc:1645] Marking committed up to 1
0204 09:00:01.909402 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.909482 (+ 80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:01.963027 (+ 53545us) raft_consensus.cc:1685] finished
0204 09:00:01.963047 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:01.963179 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":5780,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":203487,"threads_started":1,"wal-append.queue_time_us":234440}
I20260204 09:00:01.972705 18450 pending_rounds.cc:85] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Aborting all ops after (but not including) 2
I20260204 09:00:01.952003 19104 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:01.976611 18370 raft_consensus.cc:2393] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:01.974777 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.973426 20181 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:01.967095 19646 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:01.976883 18450 pending_rounds.cc:107] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260204 09:00:01.980191 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 09:00:01.980188 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:01.981029 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.981498 20140 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:01.982244 20078 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:01.983940 19105 raft_consensus.cc:1240] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:01.986881 19660 consensus_queue.cc:1059] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260204 09:00:01.987078 18488 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:01.988476 18450 raft_consensus.cc:2889] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:00:01.999038 18377 raft_consensus.cc:2393] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 8: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:02.001629 19050 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.011191 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.011581 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:01.971114 19101 rpcz_store.cc:276] 0204 08:59:58.437759 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:01.742308 (+3304549us) service_pool.cc:225] Handling call
0204 09:00:01.742671 (+ 363us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:01.949572 (+206901us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:01.961225 (+ 11653us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54000037d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:01.961384 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":450677632}
I20260204 09:00:02.012574 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.006661 18444 raft_consensus.cc:2468] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
W20260204 09:00:02.011406 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 43946.6us
I20260204 09:00:02.015151 18445 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 09:00:02.011286 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:01.992666 19646 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:02.025519 18343 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.030386 18523 raft_consensus.cc:1240] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: []
I20260204 09:00:01.969672 20191 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.024986 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.035089 19050 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.018860 20207 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.037606 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:01.994575 18369 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 09:00:02.040740 18377 raft_consensus.cc:1275] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:02.039620 18373 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 09:00:02.042977 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.020634 20126 raft_consensus.cc:2749] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 09:00:02.042946 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.049782 18372 raft_consensus.cc:1275] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260204 09:00:02.024560 20078 consensus_queue.cc:1059] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260204 09:00:02.050431 18374 raft_consensus.cc:2393] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:02.032840 19646 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.051714 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.093777 20102 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:02.094144 18450 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 09:00:02.047355 18343 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.082988 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.095253 18523 raft_consensus.cc:2410] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:02.083177 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.037385 20080 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:02.096480 20080 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:02.096828 20080 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.083830 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:02.099771 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.099977 18368 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 09:00:02.083024 20258 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:02.084452 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.088804 20191 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:02.101379 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:02.102347 19646 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.017860 19952 consensus_queue.cc:1059] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
W20260204 09:00:02.105126 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 69048.6us
W20260204 09:00:02.105897 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 58646.2us
I20260204 09:00:02.091934 20192 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:02.092626 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:02.106887 18517 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
W20260204 09:00:02.109740 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 60151.7us
I20260204 09:00:02.042327 20198 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:02.034698 20189 consensus_queue.cc:1059] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260204 09:00:02.117906 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.101465 18520 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 09:00:02.123283 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.110502 20184 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:02.128918 19108 raft_consensus.cc:1240] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:02.037561 20230 consensus_queue.cc:1059] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260204 09:00:02.144110 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.144994 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.104600 20245 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:02.143704 19107 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:02.144922 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:02.139909 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 120275us
I20260204 09:00:02.140555 20184 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:02.151443 20184 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.156375 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.156728 20230 raft_consensus.cc:3055] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 09:00:02.165604 19099 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
W20260204 09:00:02.165463 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 117558us
I20260204 09:00:02.151674 18343 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.157217 20230 raft_consensus.cc:740] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:02.169458 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.169606 20230 consensus_queue.cc:260] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.170284 18368 raft_consensus.cc:2393] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
W20260204 09:00:02.158885 18340 leader_election.cc:336] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Timed out: RequestConsensusVote RPC to 127.15.3.196:33765 timed out after 2.011s (SENT)
I20260204 09:00:02.148433 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:02.172221 18341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.167232 18491 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:02.173573 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.171722 19106 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 09:00:02.157263 19104 raft_consensus.cc:2393] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:02.176625 19660 consensus_queue.cc:1059] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 09:00:02.176852 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.177798 20181 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:02.178857 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.179490 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.149995 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.175491 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.139195 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.180819 18522 raft_consensus.cc:2410] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260204 09:00:02.188436 18375 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 09:00:02.180433 18340 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:02.190862 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.192736 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.124305 20191 consensus_queue.cc:1059] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260204 09:00:02.171030 19781 raft_consensus.cc:3055] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:02.196085 18445 raft_consensus.cc:2393] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:02.196983 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.197142 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.180096 20189 raft_consensus.cc:3055] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:02.180783 19952 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:02.198060 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.209473 18444 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:02.210824 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:02.212541 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.191339 19985 raft_consensus.cc:2804] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:02.216665 18491 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:02.214170 20102 raft_consensus.cc:3055] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:02.240842 20102 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:02.195432 18369 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:02.228989 20174 raft_consensus.cc:2804] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 09:00:02.241994 19050 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:02.242388 20174 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:02.242686 19745 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:02.242885 20174 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:02.206418 20189 raft_consensus.cc:740] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.239986 19814 raft_consensus.cc:3055] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:02.240177 19101 raft_consensus.cc:2393] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:02.241756 18516 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 4.
I20260204 09:00:02.228826 20140 consensus_queue.cc:1048] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260204 09:00:02.246047 20189 consensus_queue.cc:260] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:02.197340 19781 raft_consensus.cc:740] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:02.247269 20189 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.247867 19781 consensus_queue.cc:260] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.248823 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.249017 19781 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.249402 19106 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.250581 20174 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:02.241629 18414 leader_election.cc:336] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765): Timed out: RequestConsensusVote RPC to 127.15.3.196:33765 timed out after 2.594s (SENT)
W20260204 09:00:02.247943 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 89095.3us
I20260204 09:00:02.243376 19050 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.243435 20245 raft_consensus.cc:2804] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 09:00:02.253064 20245 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:02.253427 20245 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:02.251487 19814 raft_consensus.cc:740] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:02.254528 19814 consensus_queue.cc:260] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:02.255689 19814 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.241698 20102 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.256194 19963 raft_consensus.cc:3055] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:02.256606 19963 raft_consensus.cc:740] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:02.236757 19646 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:02.257387 19963 consensus_queue.cc:260] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.258056 19050 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:02.212468 19952 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.258543 19963 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.258965 20198 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 09:00:02.209323 20257 consensus_queue.cc:1059] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260204 09:00:02.260496 20257 raft_consensus.cc:3055] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:02.260900 20257 raft_consensus.cc:740] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.261624 20257 consensus_queue.cc:260] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:02.262768 20257 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.264241 20243 raft_consensus.cc:3055] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:02.260425 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:02.266434 18374 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.265535 20102 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.259694 20198 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:02.255546 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.210642 19794 raft_consensus.cc:2804] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 09:00:02.214738 20230 raft_consensus.cc:3060] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:02.280776 18517 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 09:00:02.210507 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:02.264664 20273 log.cc:927] Time spent T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.153s user 0.001s sys 0.000s
W20260204 09:00:02.284492 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.214640 19973 raft_consensus.cc:2749] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:02.267957 19952 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:02.287914 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 46327.7us
I20260204 09:00:02.219434 19985 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:02.264660 20243 raft_consensus.cc:740] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:02.255689 20193 consensus_queue.cc:1048] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260204 09:00:02.252067 20080 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.283133 20198 raft_consensus.cc:697] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:02.304780 19050 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 09:00:02.308274 18341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:02.311861 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 56394.5us
I20260204 09:00:02.295156 19964 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:02.287117 19794 raft_consensus.cc:697] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:02.294235 19985 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.317597 18414 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:02.321300 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.321962 19107 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.288411 20184 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.314090 18371 raft_consensus.cc:2393] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:02.286954 20245 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:02.335021 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.316479 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.314561 19964 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:02.339627 20080 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:02.340502 20198 consensus_queue.cc:237] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:02.343884 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 58585us
I20260204 09:00:02.345366 19050 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:02.331601 20243 consensus_queue.cc:260] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.347271 20129 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:02.347781 18340 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:02.349419 18340 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.351824 19973 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:02.352216 19973 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:02.352560 19973 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.356706 20082 raft_consensus.cc:2749] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 09:00:02.357443 20082 consensus_queue.cc:1059] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:02.331143 19952 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:02.331315 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.362058 20243 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:02.363927 18489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:02.364570 18415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.366173 19050 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.374030 19104 raft_consensus.cc:1275] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260204 09:00:02.375633 20263 consensus_meta.cc:287] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.598s user 0.010s sys 0.000s
I20260204 09:00:02.379706 20126 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election won for term 4
I20260204 09:00:02.380321 20126 raft_consensus.cc:697] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:02.332558 19646 consensus_queue.cc:1059] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260204 09:00:02.382261 19646 consensus_queue.cc:1059] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 09:00:02.382464 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.383816 20191 raft_consensus.cc:3055] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:02.384169 20191 raft_consensus.cc:740] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:02.384694 20174 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:02.308298 20264 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:02.384997 20191 consensus_queue.cc:260] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.385465 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.386246 20191 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.386730 20264 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:02.381170 18417 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:02.387521 18518 raft_consensus.cc:2393] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:02.388206 19109 raft_consensus.cc:1240] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:02.389953 20184 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:02.390266 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.369904 20245 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:02.371443 19100 raft_consensus.cc:1240] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:02.372123 18414 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:02.372408 19952 consensus_queue.cc:1048] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 09:00:02.392644 19794 consensus_queue.cc:237] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.392576 20078 raft_consensus.cc:2749] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:02.395202 18414 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:02.397293 18417 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:02.398144 18417 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:02.367492 20192 raft_consensus.cc:3055] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 09:00:02.381220 20126 consensus_queue.cc:237] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.373274 19106 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 7.
I20260204 09:00:02.403362 20078 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 09:00:02.404851 19050 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:02.386956 20181 raft_consensus.cc:3055] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:02.407938 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.407518 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.408519 19893 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:02.414036 20207 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:02.414758 19985 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.415676 20245 consensus_queue.cc:1048] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:02.416863 19107 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
W20260204 09:00:02.417775 19131 debug-util.cc:398] Leaking SignalData structure 0x7b080030f4a0 after lost signal to thread 15378
W20260204 09:00:02.418287 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.419023 19973 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:02.421844 18374 raft_consensus.cc:2468] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:02.426360 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 09:00:02.433744 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 221857us
W20260204 09:00:02.450685 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:02.451275 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 46491.6us
I20260204 09:00:02.396163 19964 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.457196 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.464356 19109 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.431070 19963 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:02.420568 20192 raft_consensus.cc:740] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.480721 19963 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:02.481130 19963 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.481195 20192 consensus_queue.cc:260] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:02.482447 20192 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:02.470734 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.484145 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.461428 19106 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.480877 19985 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:02.485057 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.434192 19952 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:02.494390 19952 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:02.494788 19952 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.461913 19050 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:02.433415 20196 raft_consensus.cc:2749] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:02.450909 20181 raft_consensus.cc:740] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:02.466051 18343 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.470492 18520 raft_consensus.cc:1275] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 09:00:02.470885 18525 raft_consensus.cc:1240] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:02.451884 20258 consensus_queue.cc:1048] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260204 09:00:02.431514 20174 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260204 09:00:02.471616 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.470819 18518 raft_consensus.cc:1240] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:02.472383 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.473434 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.473702 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.474684 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:02.475723 20207 consensus_queue.cc:1059] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 09:00:02.506656 18524 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:02.476722 19973 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:02.477011 18488 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.485047 18521 raft_consensus.cc:2410] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:02.452580 19893 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 09:00:02.499115 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 48525.2us
I20260204 09:00:02.503198 19106 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
W20260204 09:00:02.507463 18341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.509872 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.504624 20257 raft_consensus.cc:2804] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election won for term 7
I20260204 09:00:02.511857 20257 raft_consensus.cc:697] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.514181 18343 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.516572 19814 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 09:00:02.513062 19131 debug-util.cc:398] Leaking SignalData structure 0x7b08001b82a0 after lost signal to thread 18234
I20260204 09:00:02.510074 19893 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.522316 19106 pending_rounds.cc:85] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Aborting all ops after (but not including) 4
I20260204 09:00:02.472004 19745 consensus_queue.cc:1059] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260204 09:00:02.532219 19109 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:02.541718 18488 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:02.512421 18516 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:02.523841 19106 pending_rounds.cc:107] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260204 09:00:02.517942 20263 consensus_queue.cc:1048] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260204 09:00:02.516651 19660 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:02.520377 20282 raft_consensus.cc:2804] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:02.557638 19106 raft_consensus.cc:2889] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:00:02.547353 20245 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260204 09:00:02.564824 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 213497us
I20260204 09:00:02.567471 18340 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:02.567363 18488 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.523048 20181 consensus_queue.cc:260] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.561352 20174 raft_consensus.cc:2804] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:02.583636 18340 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.584093 18343 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.564432 20245 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:02.564193 20129 raft_consensus.cc:697] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:02.593008 18343 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.569114 20282 raft_consensus.cc:697] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 09:00:02.594091 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 132268us
I20260204 09:00:02.594453 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.595098 18340 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:02.596004 19104 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.600982 19104 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
W20260204 09:00:02.590112 19131 debug-util.cc:398] Leaking SignalData structure 0x7b0800375460 after lost signal to thread 18401
I20260204 09:00:02.603605 18488 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.604260 19050 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:02.585450 20174 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:02.588115 20184 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260204 09:00:02.602231 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.603310 18343 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.568946 19988 consensus_queue.cc:1048] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260204 09:00:02.592156 20245 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.591267 19660 raft_consensus.cc:2749] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260204 09:00:02.613341 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 161355us
I20260204 09:00:02.609941 18488 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:02.606367 19050 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 09:00:02.603310 19131 debug-util.cc:398] Leaking SignalData structure 0x7b080012ac80 after lost signal to thread 18402
I20260204 09:00:02.592789 20189 raft_consensus.cc:2804] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:02.593010 20193 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:02.611197 18340 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.565677 20257 consensus_queue.cc:237] T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.604518 19985 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 09:00:02.608664 20174 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:02.629432 20282 consensus_queue.cc:237] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.609274 20263 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.608520 20184 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:02.613900 20080 raft_consensus.cc:2804] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 09:00:02.635789 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.616318 19745 raft_consensus.cc:2804] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 09:00:02.615720 20135 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:02.638273 18451 raft_consensus.cc:3060] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.638504 18488 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.631825 20129 consensus_queue.cc:237] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.635968 19794 raft_consensus.cc:2804] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 09:00:02.643319 19745 raft_consensus.cc:697] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.643989 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.644241 19745 consensus_queue.cc:237] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.644959 18446 raft_consensus.cc:2393] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 6: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:02.639508 19985 raft_consensus.cc:697] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.632297 20287 raft_consensus.cc:2764] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260204 09:00:02.643926 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.651360 18488 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:02.653528 18443 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:02.632701 19964 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:02.655332 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.655805 19794 raft_consensus.cc:697] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:02.655933 18446 raft_consensus.cc:3060] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.656690 19964 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:02.649919 19985 consensus_queue.cc:237] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.652072 20080 raft_consensus.cc:697] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.637511 20184 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.658521 20080 consensus_queue.cc:237] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.635700 20192 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:02.636744 20198 raft_consensus.cc:2764] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260204 09:00:02.670856 19814 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:02.651924 19660 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.678169 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:02.690375 18450 raft_consensus.cc:2468] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 09:00:02.639895 20258 consensus_queue.cc:1048] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260204 09:00:02.695128 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.693233 18488 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 09:00:02.672008 19131 debug-util.cc:398] Leaking SignalData structure 0x7b0800200320 after lost signal to thread 18475
I20260204 09:00:02.697844 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.698487 18444 raft_consensus.cc:3060] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.700480 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.701434 18442 raft_consensus.cc:2410] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260204 09:00:02.700352 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.706281 18443 raft_consensus.cc:1275] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260204 09:00:02.706889 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.707490 18447 raft_consensus.cc:3060] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.656726 19794 consensus_queue.cc:237] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:02.674685 19814 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 09:00:02.711397 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:02.697362 19131 debug-util.cc:398] Leaking SignalData structure 0x7b08000df1e0 after lost signal to thread 18476
I20260204 09:00:02.693907 19988 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:02.713930 18340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:02.714097 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:02.731389 18448 raft_consensus.cc:2393] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 3: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
W20260204 09:00:02.732151 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 117357us
I20260204 09:00:02.731611 20082 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:02.737021 20082 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.738884 20082 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:02.739936 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 09:00:02.740630 20289 log.cc:927] Time spent T 00000000000000000000000000000000 P 0e2ca9d5b67049599afaed529bf98097: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
I20260204 09:00:02.745246 18447 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:02.694272 20189 raft_consensus.cc:697] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.741652 20102 raft_consensus.cc:3055] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:02.718695 20207 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.715670 19814 raft_consensus.cc:3060] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.768378 18444 raft_consensus.cc:2468] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:02.756748 18340 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:02.735286 19964 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:02.734851 20288 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:02.766405 18414 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:02.759094 20102 raft_consensus.cc:740] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:02.801743 18446 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:02.805238 18414 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:02.806039 19646 raft_consensus.cc:2764] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260204 09:00:02.796298 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 103178us
I20260204 09:00:02.807060 18488 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.756177 19988 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:02.810211 18414 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:02.813427 18488 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:02.818403 19646 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:02.819705 18414 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:02.809563 20202 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260204 09:00:02.812150 19131 debug-util.cc:398] Leaking SignalData structure 0x7b080012ba00 after lost signal to thread 18549
I20260204 09:00:02.821382 18451 raft_consensus.cc:2468] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 7.
I20260204 09:00:02.824332 18488 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.822078 18414 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:02.829389 19646 raft_consensus.cc:2764] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260204 09:00:02.834220 19973 raft_consensus.cc:3055] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 09:00:02.834671 19973 raft_consensus.cc:740] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:02.826025 20303 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:02.835578 19973 consensus_queue.cc:260] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.836747 20291 consensus_queue.cc:1048] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260204 09:00:02.839951 20292 log.cc:927] Time spent T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.097s user 0.000s sys 0.001s
W20260204 09:00:02.841346 20296 log.cc:927] Time spent T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260204 09:00:02.801550 19964 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.820849 20202 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:02.848801 18488 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 09:00:02.825598 19131 debug-util.cc:398] Leaking SignalData structure 0x7b0800043ca0 after lost signal to thread 18550
I20260204 09:00:02.864423 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.828392 20078 raft_consensus.cc:2749] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 09:00:02.825838 20264 raft_consensus.cc:2749] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:02.872965 19106 raft_consensus.cc:1240] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 2. Current term is 3. Ops: []
W20260204 09:00:02.864444 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 107757us
I20260204 09:00:02.815515 19781 consensus_queue.cc:1048] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260204 09:00:02.833513 20193 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:02.876217 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:02.865478 20300 log.cc:927] Time spent T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
I20260204 09:00:02.877676 18375 raft_consensus.cc:2376] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3. Re-sending same reply.
I20260204 09:00:02.882215 19963 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.867436 20245 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.884544 19988 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:02.885536 20245 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:02.805087 20288 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.878998 19781 consensus_queue.cc:1243] T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer 44601d9bf1ce4a70a5b01dcfc505d276 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260204 09:00:02.887316 20288 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:02.887769 20297 consensus_queue.cc:1048] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260204 09:00:02.865401 20202 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:02.822009 20174 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:02.865221 20303 raft_consensus.cc:2749] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 09:00:02.900017 20135 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:02.904893 20135 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:02.905128 18523 raft_consensus.cc:1240] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:02.907243 20174 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:02.900130 18414 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:02.907896 18370 pending_rounds.cc:85] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276: Aborting all ops after (but not including) 3
I20260204 09:00:02.908278 18370 pending_rounds.cc:107] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260204 09:00:02.908571 18370 raft_consensus.cc:2889] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:00:02.909047 19781 raft_consensus.cc:2804] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 09:00:02.867275 20102 consensus_queue.cc:260] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:02.909610 19781 raft_consensus.cc:697] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 09:00:02.910871 19131 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc340 after lost signal to thread 19135
I20260204 09:00:02.910488 19781 consensus_queue.cc:237] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.912053 19050 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.913173 20129 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:02.913332 19050 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.910326 20102 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:02.901307 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 52604.7us
I20260204 09:00:02.916612 18488 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.896544 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.917308 18374 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 09:00:02.918455 18414 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:02.924122 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.925628 20129 raft_consensus.cc:697] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
W20260204 09:00:02.925976 20191 consensus_meta.cc:287] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.539s user 0.003s sys 0.010s
I20260204 09:00:02.928105 19050 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.929396 19050 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.907961 20174 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 09:00:02.942312 18340 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.926663 20129 consensus_queue.cc:237] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:02.944782 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:02.945930 19964 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:02.946233 20287 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260204 09:00:02.947677 19646 consensus_queue.cc:1059] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:02.919493 20245 consensus_queue.cc:1059] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260204 09:00:02.945792 20198 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 09:00:02.949076 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 98598.9us
I20260204 09:00:02.950366 18488 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:02.924767 20078 raft_consensus.cc:2804] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 09:00:02.952553 19099 raft_consensus.cc:1275] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 09:00:02.870078 20189 consensus_queue.cc:237] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:02.927469 20126 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:02.919059 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:02.955830 20299 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:02.956566 18340 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.956987 20282 consensus_queue.cc:1048] T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260204 09:00:02.964577 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:02.965199 19106 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:02.957034 18488 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:02.958098 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:02.961601 18340 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.962000 19050 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.968128 18340 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.972674 18340 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:02.975101 19050 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:02.954350 20078 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:02.931092 20297 consensus_queue.cc:1048] T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260204 09:00:02.958746 19963 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:02.940107 19988 consensus_queue.cc:1059] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260204 09:00:02.998603 20309 raft_consensus.cc:2749] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:02.999023 19988 raft_consensus.cc:3055] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:02.999362 20198 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:02.999815 20198 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:03.000145 20198 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:03.001909 20202 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:02.980162 18340 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:02.981688 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.989389 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:02.974532 20193 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:03.003419 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.004071 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.007050 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:03.007707 18525 raft_consensus.cc:2410] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260204 09:00:03.007751 18450 raft_consensus.cc:2468] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:03.008628 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:03.010694 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:03.004942 18444 raft_consensus.cc:1240] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:03.007203 18517 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:03.016605 18340 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.016770 18446 raft_consensus.cc:1240] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260204 09:00:02.978657 20078 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:03.019970 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:03.021194 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 70205.8us
I20260204 09:00:03.022763 18414 leader_election.cc:304] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:03.022892 20309 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:03.024166 18445 raft_consensus.cc:1240] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
W20260204 09:00:03.005739 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 55755.7us
I20260204 09:00:03.029191 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:02.993412 20299 raft_consensus.cc:2749] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 09:00:03.023335 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:03.032388 18376 raft_consensus.cc:2410] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:03.030575 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:02.999403 19988 raft_consensus.cc:740] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:03.037451 19106 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 09:00:03.039816 18447 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:02.992663 20313 raft_consensus.cc:2804] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 09:00:03.048393 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.050956 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:03.051374 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:03.053928 18445 raft_consensus.cc:3060] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:03.056452 18517 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:03.025831 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.058382 18373 raft_consensus.cc:1240] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:03.055042 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.062187 18375 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:03.029764 20304 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:03.062839 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.029081 20174 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 09:00:03.066370 18414 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 09:00:03.076330 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 59813.2us
I20260204 09:00:03.067164 18447 raft_consensus.cc:1240] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:03.036785 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:03.096323 18520 raft_consensus.cc:2376] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5. Re-sending same reply.
I20260204 09:00:03.062976 20313 raft_consensus.cc:697] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:03.099983 19660 raft_consensus.cc:2749] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:03.092959 20299 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:03.104486 18524 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:03.104439 20299 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:03.106662 20299 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:03.093561 20298 raft_consensus.cc:2804] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 09:00:03.080265 20306 consensus_queue.cc:1059] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260204 09:00:03.048264 20314 consensus_queue.cc:1048] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260204 09:00:03.050711 19964 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:03.091079 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:03.054277 20202 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:03.073108 20304 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:03.112933 18450 raft_consensus.cc:1240] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:03.072455 20312 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.081406 20243 raft_consensus.cc:2749] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:03.118764 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:03.119349 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 53061.1us
I20260204 09:00:03.103783 20174 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.122087 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:03.115597 20304 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:03.107463 20298 raft_consensus.cc:697] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:03.126652 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:03.130692 18415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:03.119508 18368 pending_rounds.cc:85] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Aborting all ops after (but not including) 2
I20260204 09:00:03.122100 20313 consensus_queue.cc:237] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.143218 18340 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.144950 18340 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.146258 20306 consensus_queue.cc:1059] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 09:00:03.147395 20306 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 09:00:03.148070 20306 raft_consensus.cc:3055] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:03.148404 20306 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:03.149179 20306 consensus_queue.cc:260] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:03.150627 20306 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:03.154347 19109 raft_consensus.cc:1275] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 09:00:03.157267 20298 consensus_queue.cc:237] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:03.162428 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 188108us
W20260204 09:00:03.169629 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 116331us
I20260204 09:00:03.170050 18524 raft_consensus.cc:2410] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:03.171023 19050 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:03.174561 18450 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:03.162339 18368 pending_rounds.cc:107] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260204 09:00:03.177701 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:03.173185 20263 consensus_meta.cc:287] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.536s user 0.009s sys 0.000s
I20260204 09:00:03.163748 20140 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260204 09:00:03.232372 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 61421.3us
W20260204 09:00:03.238960 20328 log.cc:927] Time spent T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
I20260204 09:00:03.191296 18445 raft_consensus.cc:2468] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 09:00:03.235157 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260204 09:00:03.242756 18442 raft_consensus.cc:1275] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 09:00:03.243350 19781 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.243810 18340 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:03.243968 19781 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:03.232606 18518 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:03.140533 20202 consensus_queue.cc:1059] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260204 09:00:03.127427 20174 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:03.114969 19988 consensus_queue.cc:260] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.189535 20196 raft_consensus.cc:2749] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260204 09:00:03.256379 18488 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.180583 18368 raft_consensus.cc:2889] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:00:03.281629 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.258103 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:03.273052 20345 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:03.275735 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.256793 20263 raft_consensus.cc:2749] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:03.281582 20319 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:03.283593 18491 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:03.271955 19050 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.172315 19745 consensus_queue.cc:1048] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260204 09:00:03.248710 20288 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.126159 20312 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.302241 19109 raft_consensus.cc:1240] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:03.280664 18340 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.259050 20313 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:03.248826 20320 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:03.299330 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:03.283099 20102 consensus_queue.cc:1048] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260204 09:00:03.301673 20334 log.cc:927] Time spent T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.133s user 0.001s sys 0.000s
I20260204 09:00:03.309509 19050 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 09:00:03.312695 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 76216.5us
I20260204 09:00:03.314692 18488 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.290659 20345 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:03.326372 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:03.327479 19106 raft_consensus.cc:1275] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:03.269683 20245 consensus_queue.cc:1048] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260204 09:00:03.329272 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 67539.7us
W20260204 09:00:03.308030 19952 consensus_meta.cc:287] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.813s user 0.012s sys 0.000s
I20260204 09:00:03.327392 20263 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.304505 19660 raft_consensus.cc:2804] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 09:00:03.333204 18450 raft_consensus.cc:1275] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:03.283639 19814 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:03.306913 19988 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:03.291337 20330 raft_consensus.cc:2749] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:03.307241 20299 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:03.312294 20243 raft_consensus.cc:3055] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Stepping down as leader of term 5
W20260204 09:00:03.328474 20207 consensus_meta.cc:287] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.558s user 0.007s sys 0.003s
I20260204 09:00:03.332181 20263 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:03.326134 20258 raft_consensus.cc:2749] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:03.306860 20288 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.328372 20345 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:03.349166 20140 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:03.369213 19973 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:03.395952 20140 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:03.396545 20330 raft_consensus.cc:2749] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 09:00:03.397322 19106 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
I20260204 09:00:03.342213 20243 raft_consensus.cc:740] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:03.397922 19106 raft_consensus.cc:606] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.398272 19106 raft_consensus.cc:614] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 09:00:03.368849 20298 raft_consensus.cc:2749] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 09:00:03.351852 18373 raft_consensus.cc:1240] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:03.347033 19050 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:03.403313 18522 raft_consensus.cc:1240] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Rejecting Update request from peer 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260204 09:00:03.403825 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 56869.9us
I20260204 09:00:03.342172 20082 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260204 09:00:03.325664 20313 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:03.344179 20174 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:03.332085 20257 consensus_queue.cc:1048] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
W20260204 09:00:03.419688 20307 log.cc:927] Time spent T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.307s user 0.001s sys 0.000s
I20260204 09:00:03.416749 20313 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:03.405589 19050 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:03.345793 19794 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.345443 20207 raft_consensus.cc:2749] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:03.345871 20126 raft_consensus.cc:2749] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 09:00:03.345964 20181 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:03.348446 19781 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:03.336378 19952 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:03.395120 18488 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.453415 18516 raft_consensus.cc:2468] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 7.
W20260204 09:00:03.453702 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 122593us
I20260204 09:00:03.416630 20263 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:03.418402 19106 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "93c6901415594017879443427a92d4c9"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
W20260204 09:00:03.419111 20322 log.cc:927] Time spent T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.245s user 0.001s sys 0.000s
I20260204 09:00:03.449611 20332 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
W20260204 09:00:03.416114 19893 consensus_meta.cc:287] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.867s user 0.010s sys 0.001s
I20260204 09:00:03.312315 20319 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.456060 18444 raft_consensus.cc:1240] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:03.456944 19106 raft_consensus.cc:606] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.453444 18414 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:03.413282 20298 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260204 09:00:03.413512 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:03.466634 19106 raft_consensus.cc:614] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260204 09:00:03.472798 18340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:03.474743 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:03.423336 20198 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.472072 19893 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:03.479306 20312 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 09:00:03.479851 20315 log.cc:927] Time spent T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.279s user 0.004s sys 0.000s
I20260204 09:00:03.480331 19893 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:03.480999 20078 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:03.481981 18373 raft_consensus.cc:1275] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260204 09:00:03.482584 20340 log.cc:927] Time spent T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
W20260204 09:00:03.483747 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:03.482039 18446 raft_consensus.cc:1240] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:03.484377 19109 raft_consensus.cc:3055] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:03.485176 19109 raft_consensus.cc:740] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:03.485854 19109 consensus_queue.cc:260] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:03.497375 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
W20260204 09:00:03.498633 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 141972us
I20260204 09:00:03.453087 19794 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.499878 20263 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 2 FOLLOWER]: Advancing to term 3
W20260204 09:00:03.500332 20335 log.cc:927] Time spent T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.132s user 0.000s sys 0.000s
I20260204 09:00:03.491853 20243 consensus_queue.cc:260] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:03.501914 19814 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:03.449741 20330 consensus_queue.cc:1059] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260204 09:00:03.467703 19988 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.509083 19102 raft_consensus.cc:1275] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260204 09:00:03.510711 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 57363us
I20260204 09:00:03.465502 20174 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:03.512799 18374 raft_consensus.cc:2468] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 09:00:03.515065 18340 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:03.514192 19893 raft_consensus.cc:2749] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260204 09:00:03.513527 19660 raft_consensus.cc:697] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:03.535023 19794 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:03.547696 20345 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:03.551960 18449 raft_consensus.cc:1275] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260204 09:00:03.549001 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 220685us
I20260204 09:00:03.564829 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:03.565330 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:03.566280 19102 raft_consensus.cc:2410] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260204 09:00:03.568050 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:03.545912 20184 consensus_meta.cc:287] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.887s user 0.011s sys 0.000s
I20260204 09:00:03.574698 18443 raft_consensus.cc:2393] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:03.514647 19988 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.524489 20174 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:03.588346 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:03.588521 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:03.575506 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:03.643517 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:03.643039 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:03.541246 19973 consensus_queue.cc:1048] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260204 09:00:03.665917 18516 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5"
dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
mode: GRACEFUL
new_leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
from {username='slave'} at 127.0.0.1:52174
I20260204 09:00:03.670588 18516 raft_consensus.cc:606] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Received request to transfer leadership to TS 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:03.665067 18375 raft_consensus.cc:2393] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:03.647274 19050 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:03.550253 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:03.656327 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:03.665067 18373 raft_consensus.cc:2393] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:03.664919 19104 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 8.
I20260204 09:00:03.537365 20189 consensus_queue.cc:1048] T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260204 09:00:03.671095 18516 raft_consensus.cc:614] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 09:00:03.689864 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:03.690569 19106 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:03.692242 18449 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
W20260204 09:00:03.671890 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 138443us
I20260204 09:00:03.548979 20303 consensus_queue.cc:1059] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260204 09:00:03.717186 18414 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 09:00:03.692459 20192 consensus_meta.cc:287] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 1.004s user 0.011s sys 0.000s
W20260204 09:00:03.678413 20230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s user 0.003s sys 0.059s
I20260204 09:00:03.724120 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:03.691859 20258 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:03.760845 18375 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 8.
I20260204 09:00:03.675501 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:03.762177 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:03.588694 20184 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:03.772329 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 237633us
I20260204 09:00:03.767220 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:03.784505 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 81850.3us
I20260204 09:00:03.764953 18522 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:03.643039 19745 consensus_queue.cc:1048] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
W20260204 09:00:03.760614 20230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s user 0.003s sys 0.059s
I20260204 09:00:03.785519 18488 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:03.785069 18373 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:03.756916 20192 raft_consensus.cc:2749] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:03.656909 20304 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:03.796509 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 124082us
I20260204 09:00:03.791559 18414 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:03.810212 18377 raft_consensus.cc:1240] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:03.782757 20288 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:03.798125 20189 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.765463 20202 consensus_queue.cc:1059] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260204 09:00:03.885627 20329 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:03.882725 20346 raft_consensus.cc:2749] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:03.884464 20349 consensus_queue.cc:1048] T ef72e5825eec43c3a4efa431934ec0e1 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
W20260204 09:00:03.887853 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 99042.9us
I20260204 09:00:03.790015 20078 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:03.794217 20198 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:03.799793 20264 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260204 09:00:03.804340 20135 consensus_meta.cc:287] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.899s user 0.008s sys 0.002s
I20260204 09:00:03.892423 19050 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:03.897063 18447 raft_consensus.cc:2468] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
W20260204 09:00:03.844239 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 53013.8us
W20260204 09:00:03.913607 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:03.916136 19988 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:03.916853 20174 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:03.961086 18451 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:03.986920 20319 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:03.953375 20329 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:03.924316 18342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:03.790300 19660 consensus_queue.cc:237] T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.055335 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:03.932117 20189 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:04.006753 18488 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:03.882961 20352 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 09:00:04.063033 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 56362.3us
I20260204 09:00:04.063711 18488 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:04.064199 18521 raft_consensus.cc:1240] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 2. Current term is 3. Ops: []
I20260204 09:00:04.065176 18488 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:03.891716 20258 raft_consensus.cc:697] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:03.813534 20196 consensus_queue.cc:1048] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.168s
I20260204 09:00:04.029374 20181 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:03.887912 18249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 77578.9us
I20260204 09:00:03.917829 20354 raft_consensus.cc:2749] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:04.042210 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.057248 18522 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:04.011128 19973 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.066972 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.070690 18449 raft_consensus.cc:1275] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 09:00:04.019938 20264 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.033957 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 09:00:04.083380 20336 log.cc:927] Time spent T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.123s user 0.001s sys 0.000s
I20260204 09:00:04.088786 18373 raft_consensus.cc:1275] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260204 09:00:04.090387 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 71144.6us
I20260204 09:00:04.149304 18340 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:04.056051 20192 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.104120 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.182341 18519 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:04.104929 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.105043 20329 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.186785 18522 raft_consensus.cc:2468] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 7.
I20260204 09:00:04.187219 20393 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.187798 20393 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:04.189342 20362 log.cc:927] Time spent T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.115s user 0.001s sys 0.000s
I20260204 09:00:04.114279 20264 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.094321 19105 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
W20260204 09:00:04.132411 20372 log.cc:927] Time spent T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.307s user 0.000s sys 0.001s
I20260204 09:00:04.106958 18442 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.049961 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:04.078349 20319 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260204 09:00:04.025743 20135 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.079514 20345 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.073503 19745 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.078373 20265 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:04.079228 20174 raft_consensus.cc:2804] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:04.209291 20184 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.112164 20258 consensus_queue.cc:237] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.247830 20345 raft_consensus.cc:2749] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260204 09:00:04.248221 20361 log.cc:927] Time spent T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.447s user 0.000s sys 0.002s
I20260204 09:00:04.243969 20265 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 09:00:04.132329 20306 consensus_meta.cc:287] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.981s user 0.009s sys 0.001s
I20260204 09:00:04.133285 20384 raft_consensus.cc:3055] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:04.087800 20352 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.112779 18375 raft_consensus.cc:1275] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 09:00:04.094514 20181 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:04.105195 20367 log.cc:927] Time spent T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.150s user 0.000s sys 0.000s
W20260204 09:00:04.083384 20351 log.cc:927] Time spent T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.233s user 0.000s sys 0.001s
I20260204 09:00:04.111552 20364 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.123808 20347 raft_consensus.cc:2749] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260204 09:00:04.223467 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 74233.8us
I20260204 09:00:04.249274 20265 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.232718 18343 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:04.234706 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:04.213465 20393 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:04.232434 20349 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.238097 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:04.240530 20378 consensus_queue.cc:1059] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260204 09:00:04.130786 20325 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.224952 20319 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.327152 20319 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Advancing to term 9
I20260204 09:00:04.327792 20325 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.329931 20325 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:04.249707 19101 raft_consensus.cc:1240] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:04.246467 18442 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:04.112066 19973 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.334098 19973 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.336063 18371 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 7.
I20260204 09:00:04.297092 20380 raft_consensus.cc:2804] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:04.208666 20192 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.307176 18340 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:04.183172 20392 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.310989 20189 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:04.312247 20181 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.312553 20371 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.313007 20364 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.244719 19745 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.248482 20345 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.247553 20174 raft_consensus.cc:697] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
W20260204 09:00:04.309546 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 76942.4us
I20260204 09:00:04.287736 20304 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.286196 20384 raft_consensus.cc:740] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:04.308399 20355 consensus_queue.cc:1048] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.156s
W20260204 09:00:04.318845 20369 log.cc:927] Time spent T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.071s user 0.000s sys 0.001s
W20260204 09:00:04.316749 20263 consensus_meta.cc:287] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.816s user 0.005s sys 0.006s
W20260204 09:00:04.320721 20366 log.cc:927] Time spent T cfa617c4afef4c2f958395c561a1c8b5 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.171s user 0.000s sys 0.001s
W20260204 09:00:04.324512 20357 log.cc:927] Time spent T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.426s user 0.001s sys 0.000s
I20260204 09:00:04.312731 20352 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.310890 20135 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.395362 20371 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.324999 18369 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
W20260204 09:00:04.325644 20309 consensus_meta.cc:287] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 1.278s user 0.009s sys 0.003s
I20260204 09:00:04.396868 20309 raft_consensus.cc:2749] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:04.326570 20378 raft_consensus.cc:3055] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:04.397559 20378 raft_consensus.cc:740] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
W20260204 09:00:04.397734 18451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39114 (request call id 404) took 1416 ms (client timeout 1524 ms). Trace:
I20260204 09:00:04.398963 18368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 323) took 1377 ms. Trace:
I20260204 09:00:04.399559 20378 consensus_queue.cc:260] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.402503 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.355952 18518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 346) took 1081 ms. Trace:
I20260204 09:00:04.403226 19102 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 09:00:04.403450 18518 rpcz_store.cc:276] 0204 09:00:03.274325 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.274447 (+ 122us) service_pool.cc:225] Handling call
0204 09:00:03.274741 (+ 294us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:03.425155 (+150414us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:03.425185 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:03.425224 (+ 39us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:03.425252 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.355626 (+930374us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000dd754. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:04.355698 (+ 72us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:04.355856 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":345508608}
I20260204 09:00:04.395831 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:04.357034 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:04.358196 19099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s user 0.017s sys 0.066s
W20260204 09:00:04.360410 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 53315.6us
I20260204 09:00:04.358345 18445 raft_consensus.cc:1240] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
W20260204 09:00:04.362617 20360 log.cc:927] Time spent T 56f846ea1dc8409290d5635d9ec149d0 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.167s user 0.002s sys 0.000s
I20260204 09:00:04.387746 20345 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.388209 20291 raft_consensus.cc:3055] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Stepping down as leader of term 2
I20260204 09:00:04.318442 20184 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:04.392714 20325 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 09:00:04.404918 19099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s user 0.017s sys 0.066s
W20260204 09:00:04.398167 18451 rpcz_store.cc:269] 0204 09:00:02.981275 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:02.981426 (+ 151us) service_pool.cc:225] Handling call
0204 09:00:04.397529 (+1416103us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54006a54d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:04.397661 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2088328960}
I20260204 09:00:04.405846 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 09:00:04.407158 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:04.407752 19104 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:04.408879 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.367094 20380 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 09:00:04.417899 18376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45722 (request call id 817) took 1368 ms (client timeout 1702 ms). Trace:
W20260204 09:00:04.415455 18448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s user 0.089s sys 0.126s
W20260204 09:00:04.422122 18448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s user 0.090s sys 0.126s
I20260204 09:00:04.424535 19102 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 7.
I20260204 09:00:04.400923 20378 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:04.422081 18376 rpcz_store.cc:269] 0204 09:00:03.039479 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.061003 (+ 21524us) service_pool.cc:225] Handling call
0204 09:00:04.356850 (+1295847us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5800035798. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:04.407973 (+ 51123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4779904}
I20260204 09:00:04.425632 18340 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:04.331784 20349 raft_consensus.cc:515] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.397848 19745 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.435930 18343 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:04.408474 20263 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 09:00:04.406894 20355 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 09:00:04.418918 20230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s user 0.012s sys 0.086s
I20260204 09:00:04.415527 20291 raft_consensus.cc:740] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:04.419380 20184 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.407322 20371 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.430729 20304 raft_consensus.cc:2749] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260204 09:00:04.444504 20184 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.445278 20355 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.446314 19964 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:04.446830 19964 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.447079 19745 raft_consensus.cc:2804] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election won for term 7
I20260204 09:00:04.447616 19745 raft_consensus.cc:697] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:04.448009 18340 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:04.451021 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:04.451850 18442 raft_consensus.cc:2393] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:04.454909 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.455560 18521 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 7.
I20260204 09:00:04.456139 18517 raft_consensus.cc:1275] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:04.456492 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.425309 20380 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:04.457073 18521 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 09:00:04.440348 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.458930 20358 raft_consensus.cc:3055] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:04.459692 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:04.459945 20309 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260204 09:00:04.442590 20230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s user 0.012s sys 0.087s
I20260204 09:00:04.462548 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:04.461679 20309 raft_consensus.cc:493] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.463954 18343 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:04.464335 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:04.426299 20325 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.464368 20358 raft_consensus.cc:740] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:04.465703 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:04.463740 20382 raft_consensus.cc:2749] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:04.462055 18451 raft_consensus.cc:1275] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 09:00:04.473446 18442 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 09:00:04.469936 18522 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.471555 18491 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:04.399397 18368 rpcz_store.cc:276] 0204 09:00:03.021893 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.023673 (+ 1780us) service_pool.cc:225] Handling call
0204 09:00:03.109534 (+ 85861us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:03.302202 (+192668us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:03.305132 (+ 2930us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:03.344558 (+ 39426us) log.cc:844] Serialized 26 byte log entry
0204 09:00:03.468486 (+123928us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:03.473930 (+ 5444us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:03.493094 (+ 19164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:04.398719 (+905625us) raft_consensus.cc:1685] finished
0204 09:00:04.398745 (+ 26us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:04.398882 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":53143,"threads_started":1,"wal-append.queue_time_us":216405}
W20260204 09:00:04.461936 20140 consensus_meta.cc:287] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.065s user 0.009s sys 0.002s
I20260204 09:00:04.369303 20392 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.448457 19745 consensus_queue.cc:237] T a76dccca152648179027ee96bc473ad7 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.468564 20371 raft_consensus.cc:2804] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:04.472100 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:04.478282 18491 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:04.474344 20309 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.464772 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:04.486601 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:04.487599 18442 raft_consensus.cc:2393] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:04.478068 20304 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260204 09:00:04.492739 18340 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:04.490813 18520 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.482098 20263 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:04.495385 20243 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.496610 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.498448 18340 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:04.484762 20192 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.484419 20371 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.478308 20325 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.494668 20392 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.462116 20174 consensus_queue.cc:237] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.511276 20193 raft_consensus.cc:2804] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:04.517005 20193 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.517340 20193 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
W20260204 09:00:04.497583 20332 consensus_meta.cc:287] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 1.032s user 0.008s sys 0.005s
I20260204 09:00:04.510582 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.491204 20189 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.472321 20373 consensus_queue.cc:1059] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260204 09:00:04.514467 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.522298 18517 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:04.484699 20140 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.512676 20371 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:04.497161 20304 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.473817 20384 consensus_queue.cc:260] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.499187 20288 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:04.539088 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:04.515151 20327 log.cc:927] Time spent T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.903s user 0.003s sys 0.003s
I20260204 09:00:04.520620 18521 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:04.499194 20377 consensus_queue.cc:1048] T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260204 09:00:04.472939 20368 consensus_queue.cc:1059] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260204 09:00:04.533671 20355 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:04.519037 20192 consensus_queue.cc:1048] T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260204 09:00:04.519093 20282 consensus_queue.cc:1048] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260204 09:00:04.524015 20332 raft_consensus.cc:2749] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:04.541504 20316 raft_consensus.cc:2749] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:04.499732 20291 consensus_queue.cc:260] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.542493 20140 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:04.557667 19100 raft_consensus.cc:1275] T d17b9b554db3494a9c6594df37a1ab2f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 09:00:04.560868 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.620930 19102 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:04.524188 20189 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:04.621469 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:04.623179 20189 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.624444 19102 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
I20260204 09:00:04.538179 18340 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:04.536715 20304 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:04.568713 19952 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.569564 19964 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.569434 20371 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:04.677206 19964 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.677415 20371 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:04.682168 20263 raft_consensus.cc:2749] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:04.520809 20264 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.683838 20309 raft_consensus.cc:515] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.685808 20309 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.685911 20264 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:04.629688 20363 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:04.686719 20363 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:04.571447 20349 leader_election.cc:290] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.689643 18442 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:04.564090 20355 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.576960 18370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 814) took 1684 ms. Trace:
I20260204 09:00:04.580698 20291 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:04.587847 20364 leader_election.cc:290] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:04.557669 20392 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:04.553453 20345 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.559964 20288 raft_consensus.cc:697] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:04.597360 18444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 416) took 1568 ms. Trace:
I20260204 09:00:04.599700 20314 raft_consensus.cc:3055] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:04.601171 18374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34974 (request call id 322) took 1597 ms. Trace:
I20260204 09:00:04.602931 19101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46704 (request call id 854) took 1035 ms. Trace:
I20260204 09:00:04.603715 18446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 415) took 1601 ms. Trace:
I20260204 09:00:04.605583 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.606400 20265 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.592240 20384 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:04.626221 19108 raft_consensus.cc:1275] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Refusing update from remote peer c61e83e5fb7445e8bce7eca695977903: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260204 09:00:04.626336 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 90140.5us
I20260204 09:00:04.625118 19102 raft_consensus.cc:606] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:04.629278 18522 raft_consensus.cc:2468] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:04.629745 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:04.705550 19101 rpcz_store.cc:276] 0204 09:00:03.567333 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.569166 (+ 1833us) service_pool.cc:225] Handling call
0204 09:00:03.569544 (+ 378us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:04.340076 (+770532us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.602714 (+262638us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b540000d2d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:04.602875 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1563768576}
I20260204 09:00:04.667065 20189 consensus_queue.cc:1048] T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260204 09:00:04.668011 18371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45722 (request call id 808) took 1798 ms (client timeout 1984 ms). Trace:
I20260204 09:00:04.668334 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.671703 20192 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:04.671404 20319 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.714475 19100 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 7.
I20260204 09:00:04.673542 20193 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.693080 20363 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:04.690567 18370 rpcz_store.cc:276] 0204 09:00:02.892490 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:02.892601 (+ 111us) service_pool.cc:225] Handling call
0204 09:00:02.907691 (+ 15090us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 09:00:02.928239 (+ 20548us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:02.928269 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 09:00:02.932158 (+ 3889us) log.cc:844] Serialized 52 byte log entry
0204 09:00:03.048041 (+115883us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b1800116500. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fcebe19dc91 00007fcebe1aa671 00007fceb5323c67 00007fcebe114709 00007fceb534057b 00007fceb533e81f 00007fceb5340ae2 00007fceb7f885ab 00007fceb7f8e0c3 00007fceb7f8e471 00007fceb83aa73f
0204 09:00:03.271892 (+223851us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:03.341325 (+ 69433us) log.cc:844] Serialized 14 byte log entry
0204 09:00:03.341521 (+ 196us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:03.341727 (+ 206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:04.406568 (+1064841us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b24004586a8. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5195ad4 00007fceb5193bdb 00007fceb5222ad9 00007fceb5222765 00007fceb5221dad 00007fceb7f724ae 00007fceb7f89c2c 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1
0204 09:00:04.576709 (+170141us) raft_consensus.cc:1685] finished
0204 09:00:04.576738 (+ 29us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:04.576895 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20052,"prepare.queue_time_us":136363,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":19354,"raft.queue_time_us":65248,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":13609,"spinlock_wait_cycles":35986176,"thread_start_us":240070,"threads_started":2,"wal-append.queue_time_us":505384}
I20260204 09:00:04.578168 20184 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:04.703128 19050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s user 0.000s sys 0.052s
I20260204 09:00:04.705889 18446 rpcz_store.cc:276] 0204 09:00:03.002732 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.030827 (+ 28095us) service_pool.cc:225] Handling call
0204 09:00:03.057326 (+ 26499us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:03.484889 (+427563us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.603467 (+1118578us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54005ef6d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:04.603624 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":976338176}
I20260204 09:00:04.704738 18444 rpcz_store.cc:276] 0204 09:00:03.028525 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.054737 (+ 26212us) service_pool.cc:225] Handling call
0204 09:00:03.088405 (+ 33668us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:03.466378 (+377973us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.597054 (+1130676us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400659ad4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:04.597266 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":845157760}
I20260204 09:00:04.706377 18525 raft_consensus.cc:2468] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 09:00:04.761994 18417 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:04.707397 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:04.762756 19108 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:04.704923 18374 rpcz_store.cc:276] 0204 09:00:03.011473 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.018079 (+ 6606us) service_pool.cc:225] Handling call
0204 09:00:04.600996 (+1582917us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b5400428954. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:04.601109 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1089983360}
W20260204 09:00:04.763239 19050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s user 0.000s sys 0.052s
I20260204 09:00:04.710717 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.711902 18520 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:04.712054 15375 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260204 09:00:04.712749 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:04.764194 19101 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.592938 20380 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.714442 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.715513 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:04.716418 20192 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.716284 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:04.717733 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 1008) took 1162 ms. Trace:
I20260204 09:00:04.684249 18518 raft_consensus.cc:2393] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 6: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
W20260204 09:00:04.768769 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 876371us
I20260204 09:00:04.729548 19964 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 09:00:04.714092 18371 rpcz_store.cc:269] 0204 09:00:02.869542 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:02.871740 (+ 2198us) service_pool.cc:225] Handling call
0204 09:00:03.544092 (+672352us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b5800035798. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:04.667803 (+1123711us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54006d47d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:04.667944 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1419175168}
I20260204 09:00:04.772092 20321 consensus_queue.cc:1048] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260204 09:00:04.732870 20265 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:04.734455 20358 consensus_queue.cc:260] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.739274 20382 raft_consensus.cc:3055] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:04.745424 18516 raft_consensus.cc:2393] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 6: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:04.790452 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:04.791253 18444 raft_consensus.cc:2393] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:04.704622 20202 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.765750 18517 raft_consensus.cc:2393] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 6: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:04.794121 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:04.795141 18446 raft_consensus.cc:2393] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:04.704630 20355 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.725155 18340 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:04.767514 18377 rpcz_store.cc:276] 0204 09:00:03.555043 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.555940 (+ 897us) service_pool.cc:225] Handling call
0204 09:00:03.647482 (+ 91542us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:03.810705 (+163223us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.717494 (+906789us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54005c9c54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:04.717674 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":373815680}
I20260204 09:00:04.708770 20314 raft_consensus.cc:740] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:04.775978 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:04.790524 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:04.797637 18525 raft_consensus.cc:3060] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.729871 19109 raft_consensus.cc:3060] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:04.793530 20364 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.776990 18520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52184 (request call id 348) took 1494 ms. Trace:
I20260204 09:00:04.799290 20364 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.771415 19964 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:04.800395 20358 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:04.708493 20392 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:04.769678 20192 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.808749 20364 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.809002 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:04.783806 20346 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260204 09:00:04.803895 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 78835.9us
I20260204 09:00:04.837853 18340 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:04.807698 20306 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:04.793835 20245 consensus_queue.cc:1059] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260204 09:00:04.808183 20265 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:04.711896 20288 consensus_queue.cc:237] T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:04.808033 20380 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:04.815093 15375 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260204 09:00:04.873700 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260204 09:00:04.823913 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:04.828680 19099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 840) took 1368 ms. Trace:
I20260204 09:00:04.875902 19099 rpcz_store.cc:276] 0204 09:00:03.460411 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.460641 (+ 230us) service_pool.cc:225] Handling call
0204 09:00:03.460937 (+ 296us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:03.569669 (+108732us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:03.569698 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:03.660816 (+ 91118us) log.cc:844] Serialized 26 byte log entry
0204 09:00:04.419056 (+758240us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:04.419095 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.419160 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:04.828408 (+409248us) raft_consensus.cc:1685] finished
0204 09:00:04.828429 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:04.828578 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1522,"raft.queue_time_us":16273,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":16732,"thread_start_us":802776,"threads_started":2,"wal-append.queue_time_us":1123974}
W20260204 09:00:04.828648 19107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s user 0.003s sys 0.012s
I20260204 09:00:04.801936 19050 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
W20260204 09:00:04.878189 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 76340us
I20260204 09:00:04.879073 20363 raft_consensus.cc:2749] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260204 09:00:04.830646 18450 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s user 0.007s sys 0.025s
W20260204 09:00:04.882601 18450 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s user 0.008s sys 0.025s
W20260204 09:00:04.831005 18524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.940s user 0.013s sys 0.018s
W20260204 09:00:04.883394 18524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s user 0.013s sys 0.019s
W20260204 09:00:04.831235 20258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s user 0.002s sys 0.000s
I20260204 09:00:04.856551 18340 leader_election.cc:304] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 09:00:04.811316 18414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s user 0.009s sys 0.026s
W20260204 09:00:04.860975 18447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s user 0.003s sys 0.028s
I20260204 09:00:04.790198 20382 raft_consensus.cc:740] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:04.799207 20332 consensus_queue.cc:1059] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260204 09:00:04.869938 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 09:00:04.886358 18415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s user 0.015s sys 0.019s
W20260204 09:00:04.884114 19107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s user 0.003s sys 0.013s
I20260204 09:00:04.855537 20306 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:04.914950 19109 raft_consensus.cc:1275] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260204 09:00:04.916224 19109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 839) took 1456 ms. Trace:
I20260204 09:00:04.916649 19109 rpcz_store.cc:276] 0204 09:00:03.460006 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.460565 (+ 559us) service_pool.cc:225] Handling call
0204 09:00:03.484262 (+ 23697us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:04.596410 (+1112148us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b180002d9c0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb842a496 00007fceb83645be 00007fceb83e5c1e 00007fceb83e745e 00007fceb83f17c9 00007fceb83f2096 00007fceb83eea0f 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34
0204 09:00:04.729707 (+133297us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5800612bd0. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb834b0da 00007fceb83cd177 00007fceb83e5c67 00007fceb83e745e 00007fceb83f17c9 00007fceb83f2096 00007fceb83eea0f 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34
0204 09:00:04.915924 (+186217us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.916164 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2853568128}
W20260204 09:00:04.899511 18447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.794s user 0.004s sys 0.029s
I20260204 09:00:04.898448 19108 raft_consensus.cc:2468] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:04.837390 20346 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 09:00:04.902907 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 46446.9us
W20260204 09:00:04.922662 19052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.990s user 0.036s sys 0.043s
I20260204 09:00:04.923292 18340 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:04.868779 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 09:00:04.923301 19052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s user 0.036s sys 0.043s
W20260204 09:00:04.921897 18196 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47988 (request call id 242) took 11653 ms (client timeout 15000 ms). Trace:
I20260204 09:00:04.928426 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.929211 18516 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:04.929078 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:04.930032 19109 raft_consensus.cc:1240] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:04.930207 18517 raft_consensus.cc:2393] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 6: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
W20260204 09:00:04.899335 18414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s user 0.009s sys 0.026s
I20260204 09:00:04.907976 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:04.929078 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.810298 20202 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:04.918303 19106 raft_consensus.cc:1240] T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260204 09:00:04.870998 20080 raft_consensus.cc:2804] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:04.931327 18374 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 5
W20260204 09:00:04.931231 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 857943us
I20260204 09:00:04.935750 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.936337 18516 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:04.936548 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.937161 18521 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 09:00:04.933468 18340 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:04.921033 19101 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:04.869119 20265 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 09:00:04.900329 20258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s user 0.002s sys 0.000s
I20260204 09:00:04.955451 18343 leader_election.cc:304] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:04.955621 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.949608 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.958055 18517 raft_consensus.cc:2393] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 7: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:04.956947 18343 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 09:00:04.906620 18415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s user 0.015s sys 0.019s
I20260204 09:00:04.909605 19964 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:04.799962 18520 rpcz_store.cc:276] 0204 09:00:03.274889 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.275583 (+ 694us) service_pool.cc:225] Handling call
0204 09:00:04.471914 (+1196331us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:04.768127 (+296213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3638016}
I20260204 09:00:04.901505 20312 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:04.953308 18340 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 09:00:04.981732 18449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s user 0.010s sys 0.025s
W20260204 09:00:05.016882 18449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s user 0.010s sys 0.029s
I20260204 09:00:04.922436 20306 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:05.017952 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:04.921852 20309 raft_consensus.cc:2804] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:05.020140 19108 raft_consensus.cc:3055] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:05.028808 18446 raft_consensus.cc:1275] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 09:00:05.028826 19108 raft_consensus.cc:740] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:05.031728 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:04.965500 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:05.021469 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 80238.9us
I20260204 09:00:04.920003 20135 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:05.034319 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:05.035337 19101 raft_consensus.cc:3060] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:05.038882 19109 raft_consensus.cc:2368] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5.
I20260204 09:00:05.043565 19101 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
W20260204 09:00:05.044363 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:04.944263 20346 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:04.948453 20371 raft_consensus.cc:2749] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:04.957554 20265 raft_consensus.cc:3060] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:04.955920 20264 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:05.015978 20379 raft_consensus.cc:2804] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 09:00:05.016218 20373 raft_consensus.cc:2804] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:05.058655 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:05.061546 18374 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:05.062639 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:05.062858 18414 leader_election.cc:304] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 09:00:05.026625 20378 consensus_meta.cc:287] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab: Time spent flushing consensus metadata: real 0.596s user 0.009s sys 0.000s
I20260204 09:00:05.013639 19814 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:05.069211 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.304349 18373 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
W20260204 09:00:05.069958 18448 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s user 0.020s sys 0.007s
I20260204 09:00:04.944763 20189 raft_consensus.cc:2749] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:05.028518 20309 raft_consensus.cc:493] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:05.022904 20390 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:05.250240 20392 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:04.925998 18196 rpcz_store.cc:269] 0204 08:59:53.268853 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 08:59:53.275936 (+ 7083us) service_pool.cc:225] Handling call
0204 09:00:04.921797 (+11645861us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0204 09:00:02.179759 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0204 09:00:02.296278 (+116519us) write_op.cc:432] Acquiring schema lock in shared mode
0204 09:00:02.296351 (+ 73us) write_op.cc:435] Acquired schema lock
0204 09:00:02.296369 (+ 18us) tablet.cc:660] Decoding operations
0204 09:00:02.297277 (+ 908us) write_op.cc:620] Acquiring the partition lock for write op
0204 09:00:02.297376 (+ 99us) write_op.cc:641] Partition lock acquired for write op
0204 09:00:02.297405 (+ 29us) tablet.cc:683] Acquiring locks for 8 operations
0204 09:00:02.298167 (+ 762us) tablet.cc:699] Row locks acquired
0204 09:00:02.298182 (+ 15us) write_op.cc:260] PREPARE: finished
0204 09:00:02.298356 (+ 174us) write_op.cc:270] Start()
0204 09:00:02.298527 (+ 171us) write_op.cc:276] Timestamp: P: 1770195602298286 usec, L: 0
0204 09:00:02.298557 (+ 30us) op_driver.cc:348] REPLICATION: starting
0204 09:00:02.317273 (+ 18716us) log.cc:844] Serialized 3234 byte log entry
0204 09:00:02.944530 (+627257us) op_driver.cc:464] REPLICATION: finished
0204 09:00:03.095162 (+150632us) write_op.cc:301] APPLY: starting
0204 09:00:03.095275 (+ 113us) tablet.cc:1365] starting BulkCheckPresence
0204 09:00:03.095479 (+ 204us) tablet.cc:1368] finished BulkCheckPresence
0204 09:00:03.095602 (+ 123us) tablet.cc:1370] starting ApplyRowOperation cycle
0204 09:00:03.449479 (+353877us) tablet.cc:1381] finished ApplyRowOperation cycle
0204 09:00:03.505555 (+ 56076us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0204 09:00:03.505620 (+ 65us) write_op.cc:312] APPLY: finished
0204 09:00:03.505916 (+ 296us) log.cc:844] Serialized 65 byte log entry
0204 09:00:03.506109 (+ 193us) write_op.cc:489] Releasing partition, row and schema locks
0204 09:00:03.506231 (+ 122us) write_op.cc:454] Released schema lock
0204 09:00:03.506291 (+ 60us) write_op.cc:341] FINISH: Updating metrics
0204 09:00:03.506668 (+ 377us) write_op.cc:489] Releasing partition, row and schema locks
0204 09:00:03.506697 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4594,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":105737,"apply.run_cpu_time_us":4941,"apply.run_wall_time_us":433776,"num_ops":8,"prepare.queue_time_us":261880,"prepare.run_cpu_time_us":15437,"prepare.run_wall_time_us":440829,"raft.queue_time_us":202558,"raft.run_cpu_time_us":9747,"raft.run_wall_time_us":30738,"replication_time_us":645817,"thread_start_us":433386,"threads_started":4,"wal-append.queue_time_us":300273,"wal-append.run_cpu_time_us":42819,"wal-append.run_wall_time_us":1869092}]]}
W20260204 09:00:05.191614 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 125586us
I20260204 09:00:05.029843 20184 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:05.194129 18518 raft_consensus.cc:1240] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:04.906282 20314 consensus_queue.cc:260] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.283210 19964 raft_consensus.cc:2764] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260204 09:00:05.062294 20384 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:05.063934 20364 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:04.965745 20282 consensus_queue.cc:1048] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.229s
I20260204 09:00:05.054150 20135 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:05.332835 20293 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260204 09:00:05.036417 20263 consensus_queue.cc:1048] T 79332110ca7d46dd8fb7875471d3242d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
I20260204 09:00:05.335798 20263 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:05.336372 20263 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:05.338338 20263 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:05.073274 20320 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:05.339071 20320 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:05.341229 20320 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:05.228109 20294 raft_consensus.cc:3055] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:05.341940 20294 raft_consensus.cc:740] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:05.023474 20312 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.342911 20355 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:05.239037 18445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s user 0.009s sys 0.030s
I20260204 09:00:05.343326 20245 raft_consensus.cc:3055] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Stepping down as leader of term 6
W20260204 09:00:05.343613 18445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s user 0.010s sys 0.031s
I20260204 09:00:05.345124 20245 raft_consensus.cc:740] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:05.211508 20371 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:05.346900 20371 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:05.212117 20193 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:05.037581 20382 consensus_queue.cc:260] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:05.348332 18525 consensus_meta.cc:287] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.550s user 0.008s sys 0.002s
I20260204 09:00:05.348579 20382 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:05.348750 18525 raft_consensus.cc:2468] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:05.350135 20306 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.019788 20080 raft_consensus.cc:697] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:05.351243 18371 raft_consensus.cc:1240] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:05.352258 20306 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:05.351972 20080 consensus_queue.cc:237] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.310695 19814 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:05.354278 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.032652 19108 consensus_queue.cc:260] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.355185 18371 raft_consensus.cc:2393] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:05.263671 19107 raft_consensus.cc:2393] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
W20260204 09:00:05.262326 18491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s user 0.030s sys 0.054s
W20260204 09:00:05.355902 18491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s user 0.030s sys 0.054s
I20260204 09:00:05.263195 18516 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:05.356048 19814 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:05.356449 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 878201us
I20260204 09:00:05.356086 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.357381 18371 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 7.
I20260204 09:00:05.358846 18371 raft_consensus.cc:1240] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:05.358842 19814 consensus_queue.cc:1059] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.002s
I20260204 09:00:05.360834 19814 raft_consensus.cc:3055] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:05.361160 19814 raft_consensus.cc:740] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:05.361946 19814 consensus_queue.cc:260] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.363150 19814 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:05.368532 20355 consensus_queue.cc:1059] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260204 09:00:05.369122 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:05.369571 20350 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:05.370111 20350 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:05.371686 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:05.372284 20364 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.374536 20364 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 09:00:05.375725 20387 log.cc:927] Time spent T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.181s user 0.000s sys 0.001s
W20260204 09:00:05.377562 20394 log.cc:927] Time spent T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.144s user 0.000s sys 0.000s
W20260204 09:00:05.378737 20377 consensus_queue.cc:1175] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "354a648f08a44b98a7f93d74b0ea93ab" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260204 09:00:05.380918 20314 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:05.383898 18443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 760) took 1352 ms. Trace:
I20260204 09:00:05.384367 18443 rpcz_store.cc:276] 0204 09:00:04.030978 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.031713 (+ 735us) service_pool.cc:225] Handling call
0204 09:00:04.032081 (+ 368us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:04.039313 (+ 7232us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:04.039343 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:04.040046 (+ 703us) log.cc:844] Serialized 26 byte log entry
0204 09:00:04.537579 (+497533us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:04.537620 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.537692 (+ 72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:05.382694 (+845002us) raft_consensus.cc:1685] finished
0204 09:00:05.382739 (+ 45us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.383795 (+ 1056us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":149773,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":503932,"threads_started":2,"wal-append.queue_time_us":1016787}
I20260204 09:00:05.386175 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:05.390162 20135 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:05.393317 18369 raft_consensus.cc:1240] T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:05.395932 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6b7e58d6c748838ef0cdff0f018574" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:05.396811 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:05.397187 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:05.397430 19102 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Advancing to term 9
I20260204 09:00:05.398023 19101 raft_consensus.cc:2393] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:05.307907 20379 raft_consensus.cc:697] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 09:00:05.305887 18448 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.869s user 0.020s sys 0.007s
I20260204 09:00:05.408469 18448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 1010) took 1853 ms. Trace:
W20260204 09:00:05.307287 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 244508us
I20260204 09:00:05.410182 18516 raft_consensus.cc:2468] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 09:00:05.410503 18414 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:05.174011 18343 leader_election.cc:400] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867) with higher term. Message: Invalid argument: T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for earlier term 4. Current term is 5.
W20260204 09:00:05.412073 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 370748us
I20260204 09:00:05.414335 18343 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 09:00:05.310925 18342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.088s user 0.000s sys 0.061s
I20260204 09:00:05.311107 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:05.415361 18342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.192s user 0.000s sys 0.061s
I20260204 09:00:05.249776 20349 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:05.314458 19050 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters: c61e83e5fb7445e8bce7eca695977903
W20260204 09:00:05.258167 20375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s user 0.010s sys 0.035s
I20260204 09:00:05.036219 18199 catalog_manager.cc:5654] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 4 to 5, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 5 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
I20260204 09:00:05.419521 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.420277 18373 raft_consensus.cc:2393] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:05.319864 18377 raft_consensus.cc:1240] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:05.292045 20319 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 9 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:05.283048 20264 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.308355 20373 raft_consensus.cc:697] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 09:00:05.315762 20304 consensus_meta.cc:287] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.613s user 0.005s sys 0.004s
I20260204 09:00:05.324463 20384 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:05.422528 20375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s user 0.011s sys 0.035s
I20260204 09:00:05.345992 20245 consensus_queue.cc:260] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.347216 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.391260 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:05.299288 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.355631 19108 raft_consensus.cc:3060] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
W20260204 09:00:05.438481 20174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s user 0.018s sys 0.038s
I20260204 09:00:05.313102 20309 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:05.411509 18414 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 09:00:05.421522 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 107169us
W20260204 09:00:05.458582 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 47150us
I20260204 09:00:05.459233 19050 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:05.460806 18414 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:05.461617 20321 raft_consensus.cc:2804] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:05.461970 18414 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:05.462708 20287 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election won for term 5
I20260204 09:00:05.463232 20287 raft_consensus.cc:697] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:05.312569 20401 raft_consensus.cc:2804] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader election won for term 7
W20260204 09:00:05.463793 20397 log.cc:927] Time spent T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.154s user 0.003s sys 0.001s
I20260204 09:00:05.320407 20202 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:05.427196 19102 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 9.
I20260204 09:00:05.461987 20321 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:05.408834 18448 rpcz_store.cc:276] 0204 09:00:03.555200 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.555312 (+ 112us) service_pool.cc:225] Handling call
0204 09:00:03.555670 (+ 358us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:03.575829 (+ 20159us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:03.575863 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:03.592222 (+ 16359us) log.cc:844] Serialized 26 byte log entry
0204 09:00:04.423573 (+831351us) raft_consensus.cc:1645] Marking committed up to 5
0204 09:00:05.407925 (+984352us) log.cc:844] Serialized 14 byte log entry
0204 09:00:05.408145 (+ 220us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.408220 (+ 75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:05.408258 (+ 38us) raft_consensus.cc:1685] finished
0204 09:00:05.408269 (+ 11us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.408415 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5361,"prepare.queue_time_us":403880,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":18800,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":34528,"thread_start_us":1632914,"threads_started":2,"wal-append.queue_time_us":1265446}
I20260204 09:00:05.420686 18199 catalog_manager.cc:5654] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:05.467713 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:05.469545 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:05.471172 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:05.464478 20287 consensus_queue.cc:237] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:05.438987 18522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s user 0.024s sys 0.025s
I20260204 09:00:05.439213 18377 raft_consensus.cc:1275] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260204 09:00:05.475103 18522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s user 0.024s sys 0.025s
I20260204 09:00:05.439821 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:05.477056 19107 raft_consensus.cc:2393] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:05.055859 20380 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:05.489403 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:05.490700 19105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.177s user 0.038s sys 0.039s
W20260204 09:00:05.491029 19105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.177s user 0.038s sys 0.039s
I20260204 09:00:05.396876 20355 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:05.321053 19745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s user 0.010s sys 0.036s
I20260204 09:00:05.407544 20263 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:05.424746 19964 raft_consensus.cc:2804] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:05.418383 20377 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:05.419715 20398 raft_consensus.cc:493] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 09:00:05.453899 18451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s user 0.037s sys 0.027s
I20260204 09:00:05.469931 20245 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:05.431821 20193 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:05.416253 18488 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:05.322867 20390 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:05.454847 20174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s user 0.019s sys 0.038s
I20260204 09:00:05.423146 20293 raft_consensus.cc:2804] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader election won for term 3
I20260204 09:00:05.489923 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 732) took 1788 ms. Trace:
I20260204 09:00:05.492548 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:05.469520 18199 catalog_manager.cc:5654] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } }
I20260204 09:00:05.469344 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:05.549355 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 54137.2us
I20260204 09:00:05.549893 20371 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:05.471933 20321 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:05.432329 20391 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:05.599866 20391 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:05.600291 20391 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
W20260204 09:00:05.551301 18451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s user 0.038s sys 0.028s
I20260204 09:00:05.499720 20386 raft_consensus.cc:2749] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260204 09:00:05.438762 20349 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.449515 20304 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.463152 20135 consensus_queue.cc:1059] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260204 09:00:05.531424 19745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s user 0.010s sys 0.037s
W20260204 09:00:05.575245 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 159101us
I20260204 09:00:05.494827 20392 raft_consensus.cc:2804] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 09:00:05.342839 20294 consensus_queue.cc:260] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.494614 20401 raft_consensus.cc:697] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 7 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:05.591356 18414 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:05.590508 18524 rpcz_store.cc:276] 0204 09:00:03.701928 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.702040 (+ 112us) service_pool.cc:225] Handling call
0204 09:00:03.702375 (+ 335us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:03.784460 (+ 82085us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:03.784489 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:03.786902 (+ 2413us) log.cc:844] Serialized 26 byte log entry
0204 09:00:04.883899 (+1096997us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:04.883938 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:04.884004 (+ 66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:05.417438 (+533434us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 09:00:05.472364 (+ 54926us) raft_consensus.cc:1685] finished
0204 09:00:05.472390 (+ 26us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.489842 (+ 17452us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":104346,"raft.queue_time_us":83474,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":5407104,"thread_start_us":995796,"threads_started":1,"wal-append.queue_time_us":1434460}
I20260204 09:00:05.559563 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:05.591976 20319 raft_consensus.cc:2749] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:05.586539 20379 consensus_queue.cc:237] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:05.575613 20377 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:05.645663 20377 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:05.612056 20293 raft_consensus.cc:697] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:05.590080 20373 consensus_queue.cc:237] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.592490 20193 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:05.638490 20378 raft_consensus.cc:3055] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:05.603222 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:05.596951 18369 raft_consensus.cc:2393] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:05.613008 19108 raft_consensus.cc:1275] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260204 09:00:05.489315 20329 consensus_queue.cc:1059] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.100s
I20260204 09:00:05.591475 18199 catalog_manager.cc:5654] T d25eb84b22c4469996abd8629863c279 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 5, leader changed from c61e83e5fb7445e8bce7eca695977903 (127.15.3.195) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 5 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
W20260204 09:00:05.617322 18523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.111s user 0.037s sys 0.036s
I20260204 09:00:05.546046 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.500965 20380 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:05.627377 18488 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:05.587227 19964 raft_consensus.cc:697] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:05.625424 18414 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:05.628489 18371 raft_consensus.cc:2393] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
W20260204 09:00:05.625152 19660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.138s user 0.036s sys 0.036s
I20260204 09:00:05.629451 20390 leader_election.cc:290] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:05.633143 20192 consensus_meta.cc:287] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.824s user 0.006s sys 0.003s
I20260204 09:00:05.545704 20355 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.634696 20349 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:05.635192 20386 raft_consensus.cc:2749] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 09:00:05.596915 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:05.586270 20398 raft_consensus.cc:515] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.639040 20350 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:05.674343 18443 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:05.698825 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:05.685796 19660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.206s user 0.037s sys 0.036s
I20260204 09:00:05.699505 18443 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 7.
W20260204 09:00:05.675019 19099 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.765s user 0.023s sys 0.027s
W20260204 09:00:05.675908 18523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.170s user 0.037s sys 0.036s
I20260204 09:00:05.675603 19108 pending_rounds.cc:85] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Aborting all ops after (but not including) 2
I20260204 09:00:05.702032 19108 pending_rounds.cc:107] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260204 09:00:05.676445 18377 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
W20260204 09:00:05.702407 19099 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.792s user 0.023s sys 0.027s
I20260204 09:00:05.646818 20264 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:05.680261 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 52996.6us
I20260204 09:00:05.650612 20294 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:05.572768 20263 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.638696 19893 consensus_queue.cc:1048] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260204 09:00:05.692009 18374 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Advancing to term 9
W20260204 09:00:05.695883 19104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s user 0.017s sys 0.024s
W20260204 09:00:05.797055 19104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.166s user 0.018s sys 0.025s
I20260204 09:00:05.673911 20378 raft_consensus.cc:740] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:05.676546 18199 catalog_manager.cc:5654] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 09:00:05.702293 19108 raft_consensus.cc:2889] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:00:05.730350 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:05.732230 18447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s user 0.006s sys 0.033s
W20260204 09:00:05.799176 18447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s user 0.006s sys 0.033s
I20260204 09:00:05.799966 18447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 758) took 1769 ms. Trace:
I20260204 09:00:05.760968 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.767382 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.689779 20312 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:05.688555 19988 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.806s user 0.011s sys 0.026s
I20260204 09:00:05.699146 20320 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:05.810803 20320 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.812860 20320 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:05.732030 20319 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:05.730932 20245 raft_consensus.cc:493] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:05.813990 20245 raft_consensus.cc:515] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:05.732232 20384 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:05.815917 20245 leader_election.cc:290] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:05.817103 19988 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.938s user 0.012s sys 0.026s
I20260204 09:00:05.688871 20265 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:05.819728 20265 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:05.693013 20192 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.821758 20192 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:05.822489 18521 raft_consensus.cc:1240] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 5. Current term is 6. Ops: []
W20260204 09:00:05.763898 20409 log.cc:927] Time spent T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.076s user 0.001s sys 0.000s
I20260204 09:00:05.758906 20390 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader election won for term 7
W20260204 09:00:05.781927 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 51048.6us
I20260204 09:00:05.824460 18445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 763) took 1374 ms. Trace:
I20260204 09:00:05.824616 20390 raft_consensus.cc:697] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 7 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:05.825482 20265 consensus_queue.cc:1048] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:05.824909 18445 rpcz_store.cc:276] 0204 09:00:04.449865 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.449996 (+ 131us) service_pool.cc:225] Handling call
0204 09:00:04.458730 (+ 8734us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 09:00:04.459130 (+ 400us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:04.459156 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 09:00:04.459828 (+ 672us) log.cc:844] Serialized 52 byte log entry
0204 09:00:05.344045 (+884217us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:05.344088 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.344158 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:05.824210 (+480052us) raft_consensus.cc:1685] finished
0204 09:00:05.824234 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.824399 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":883811,"threads_started":1,"wal-append.queue_time_us":1180234}
I20260204 09:00:05.827553 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:05.828228 18445 raft_consensus.cc:2393] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:05.828851 20263 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:05.829466 18445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:05.705161 19100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.931s user 0.022s sys 0.023s
I20260204 09:00:05.735311 20346 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:05.832413 18522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60760 (request call id 744) took 1122 ms. Trace:
I20260204 09:00:05.832350 20346 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:05.795674 20309 raft_consensus.cc:515] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:05.847535 18340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s user 0.015s sys 0.035s
W20260204 09:00:05.847994 18340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s user 0.015s sys 0.035s
I20260204 09:00:05.733410 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:05.800309 18447 rpcz_store.cc:276] 0204 09:00:04.030391 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.037779 (+ 7388us) service_pool.cc:225] Handling call
0204 09:00:04.038109 (+ 330us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:04.038322 (+ 213us) raft_consensus.cc:1534] Early marking committed up to index 4
0204 09:00:04.918036 (+879714us) log.cc:844] Serialized 14 byte log entry
0204 09:00:05.799591 (+881555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:05.799686 (+ 95us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:05.799730 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.799798 (+ 68us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.799912 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19997,"prepare.queue_time_us":788998,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"thread_start_us":1693603,"threads_started":2}
I20260204 09:00:05.801352 18199 catalog_manager.cc:5654] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 4 to 5, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 5 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } }
W20260204 09:00:05.732237 18450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s user 0.020s sys 0.034s
W20260204 09:00:05.851948 18450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s user 0.020s sys 0.038s
W20260204 09:00:05.791961 20258 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s user 0.017s sys 0.031s
I20260204 09:00:05.807390 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:05.766804 20403 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:05.809859 18369 raft_consensus.cc:1275] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 09:00:05.813522 18451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 765) took 1361 ms. Trace:
W20260204 09:00:05.834460 18375 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.816s user 0.029s sys 0.022s
I20260204 09:00:05.834717 18488 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
W20260204 09:00:05.835187 19100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s user 0.024s sys 0.025s
W20260204 09:00:05.856106 18375 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s user 0.029s sys 0.023s
I20260204 09:00:05.808887 20378 consensus_queue.cc:260] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.832806 18522 rpcz_store.cc:276] 0204 09:00:04.709978 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.718529 (+ 8551us) service_pool.cc:225] Handling call
0204 09:00:04.718875 (+ 346us) raft_consensus.cc:1471] Updating replica for 2 ops
0204 09:00:04.719245 (+ 370us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:04.719273 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0204 09:00:04.753061 (+ 33788us) log.cc:844] Serialized 52 byte log entry
0204 09:00:05.475507 (+722446us) raft_consensus.cc:1645] Marking committed up to 1
0204 09:00:05.475552 (+ 45us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.475621 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:05.832209 (+356588us) raft_consensus.cc:1685] finished
0204 09:00:05.832228 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.832360 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":38746,"thread_start_us":683386,"threads_started":1,"wal-append.queue_time_us":1034977}
I20260204 09:00:05.856825 18450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 1014) took 1871 ms. Trace:
I20260204 09:00:05.753183 20293 consensus_queue.cc:237] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:05.855260 18451 rpcz_store.cc:276] 0204 09:00:04.452437 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.476031 (+ 23594us) service_pool.cc:225] Handling call
0204 09:00:04.485222 (+ 9191us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:04.485439 (+ 217us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:04.485468 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:04.490165 (+ 4697us) log.cc:844] Serialized 26 byte log entry
0204 09:00:05.601139 (+1110974us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:05.601178 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.601246 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:05.813330 (+212084us) raft_consensus.cc:1685] finished
0204 09:00:05.813351 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.813468 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1080292,"threads_started":1,"wal-append.queue_time_us":1305570}
I20260204 09:00:05.759056 19964 consensus_queue.cc:237] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:05.803876 20304 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:05.855840 20258 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s user 0.017s sys 0.031s
I20260204 09:00:05.884994 18451 raft_consensus.cc:1240] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:05.858688 18199 catalog_manager.cc:5654] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 5, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 5 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } }
I20260204 09:00:05.887992 18199 catalog_manager.cc:5654] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 4, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194). New cstate: current_term: 4 leader_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } }
W20260204 09:00:05.856843 18449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s user 0.016s sys 0.017s
W20260204 09:00:05.892043 18449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s user 0.017s sys 0.017s
I20260204 09:00:05.757026 20401 consensus_queue.cc:237] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.860749 18450 rpcz_store.cc:276] 0204 09:00:03.985023 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.985186 (+ 163us) service_pool.cc:225] Handling call
0204 09:00:04.020468 (+ 35282us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:04.020676 (+ 208us) raft_consensus.cc:1534] Early marking committed up to index 4
0204 09:00:04.882967 (+862291us) log.cc:844] Serialized 14 byte log entry
0204 09:00:05.856449 (+973482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:05.856506 (+ 57us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:05.856550 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.856641 (+ 91us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.856768 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4011,"prepare.queue_time_us":806398,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":4134,"thread_start_us":1797084,"threads_started":2}
I20260204 09:00:05.800820 20202 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:05.857213 20078 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:05.871333 19660 raft_consensus.cc:2749] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:05.868487 20402 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:05.906293 20304 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
W20260204 09:00:05.911928 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:05.911787 20202 raft_consensus.cc:515] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:05.922325 20358 consensus_meta.cc:287] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.112s user 0.008s sys 0.000s
I20260204 09:00:05.924135 19105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 846) took 1705 ms. Trace:
I20260204 09:00:05.869692 20403 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:05.943432 18451 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260204 09:00:05.943813 19051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s user 0.009s sys 0.054s
W20260204 09:00:05.925014 18442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s user 0.027s sys 0.015s
I20260204 09:00:05.888553 20378 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
W20260204 09:00:05.946106 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:05.944123 19051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s user 0.009s sys 0.054s
W20260204 09:00:05.946976 18442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s user 0.028s sys 0.015s
I20260204 09:00:05.941468 19105 rpcz_store.cc:276] 0204 09:00:04.219160 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.219325 (+ 165us) service_pool.cc:225] Handling call
0204 09:00:04.238379 (+ 19054us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:04.309254 (+ 70875us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:04.309282 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:04.313550 (+ 4268us) log.cc:844] Serialized 26 byte log entry
0204 09:00:05.491361 (+1177811us) raft_consensus.cc:1645] Marking committed up to 1
0204 09:00:05.491402 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.491475 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:05.923859 (+432384us) raft_consensus.cc:1685] finished
0204 09:00:05.923885 (+ 26us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:05.924061 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":72563,"raft.queue_time_us":66595,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"thread_start_us":1177451,"threads_started":1,"wal-append.queue_time_us":1566674}
W20260204 09:00:05.861572 18444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s user 0.016s sys 0.017s
I20260204 09:00:05.858006 18488 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:05.902793 18199 catalog_manager.cc:5654] T f4a90ced875b42b0be979d1dc8a5d977 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 4, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 4 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:05.867208 18374 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 9.
I20260204 09:00:05.893476 20193 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:05.893054 20306 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:05.892773 20377 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:05.949595 18444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s user 0.016s sys 0.017s
I20260204 09:00:05.992882 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.011159 18521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60772 (request call id 731) took 1043 ms. Trace:
I20260204 09:00:06.013441 18521 rpcz_store.cc:276] 0204 09:00:04.949679 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.949819 (+ 140us) service_pool.cc:225] Handling call
0204 09:00:04.950376 (+ 557us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:05.823156 (+872780us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.992327 (+169171us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400643054. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:05.992522 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2005209984}
W20260204 09:00:05.946755 20288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s user 0.017s sys 0.027s
I20260204 09:00:05.926470 20078 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:05.988744 18371 raft_consensus.cc:1240] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
I20260204 09:00:05.940618 20304 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:06.017431 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:05.950278 20380 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:06.001199 20358 raft_consensus.cc:2749] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:05.941217 20355 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:05.973434 20245 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:06.020119 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 162170us
I20260204 09:00:06.020399 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:05.994624 20135 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:05.930441 20402 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:06.020468 20288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s user 0.018s sys 0.029s
I20260204 09:00:06.017319 18199 catalog_manager.cc:5654] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 4, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 4 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } }
W20260204 09:00:06.019776 20314 consensus_meta.cc:287] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.638s user 0.011s sys 0.000s
I20260204 09:00:05.972848 20346 consensus_queue.cc:1059] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260204 09:00:06.030797 18488 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:06.030985 19105 raft_consensus.cc:2410] T e65e67a60cd24f02a3f66afc76e2b5f0 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:06.030915 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:06.023996 19814 consensus_meta.cc:287] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.660s user 0.013s sys 0.006s
I20260204 09:00:06.045500 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.046806 20135 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:06.042654 19053 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s user 0.010s sys 0.034s
I20260204 09:00:05.993434 20306 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:05.994845 20377 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:06.061095 19053 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s user 0.011s sys 0.034s
I20260204 09:00:05.951067 20390 consensus_queue.cc:237] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:06.063757 20291 consensus_meta.cc:287] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 1.360s user 0.012s sys 0.000s
I20260204 09:00:06.066044 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:06.066278 18488 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:06.070538 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:06.071223 18451 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:06.074263 20304 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.042572 20193 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.075891 20355 consensus_queue.cc:1048] T 6da43fe9c941486e99fb39317a812801 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:06.063953 20358 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:06.077574 20358 raft_consensus.cc:493] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:06.077916 20358 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:06.075281 20193 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:06.081005 20294 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:06.081542 20294 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.083531 19814 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 9 FOLLOWER]: Leader election won for term 9
W20260204 09:00:06.084312 20406 log.cc:927] Time spent T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.304s user 0.001s sys 0.000s
I20260204 09:00:06.085708 20321 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:06.086894 20398 leader_election.cc:290] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:06.087293 20193 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.069661 18199 catalog_manager.cc:5654] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 5, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 5 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } }
I20260204 09:00:06.090539 18199 catalog_manager.cc:5654] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 4, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196). New cstate: current_term: 4 leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } }
I20260204 09:00:06.092671 18199 catalog_manager.cc:5654] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 4, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 4 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } }
I20260204 09:00:06.134095 18520 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:06.154109 18199 catalog_manager.cc:5654] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } }
I20260204 09:00:06.094588 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.097462 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.047451 20319 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:06.099613 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:06.100590 18369 raft_consensus.cc:1275] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 09:00:06.101984 18519 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:06.102846 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:06.084254 19814 raft_consensus.cc:697] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 9 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:06.104142 20135 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:06.103858 20358 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:06.045452 20245 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.105145 20202 leader_election.cc:290] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.105468 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:06.105089 20294 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.105957 20265 raft_consensus.cc:493] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.106756 20400 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.107249 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:06.107939 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:06.219614 18521 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:06.108747 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 351) took 2415 ms. Trace:
I20260204 09:00:06.110203 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:06.222286 18525 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:06.110527 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:06.110901 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:06.063825 20363 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:06.064337 20384 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.114614 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:06.251171 19105 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Advancing to term 8
W20260204 09:00:06.125607 20391 consensus_meta.cc:287] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.525s user 0.014s sys 0.003s
I20260204 09:00:06.088187 20193 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.127820 20403 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:06.130182 19100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 860) took 1365 ms. Trace:
W20260204 09:00:06.098127 20414 log.cc:927] Time spent T 263a60191abd44948307685e71fc6321 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.071s user 0.000s sys 0.001s
I20260204 09:00:06.088129 20321 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 09:00:06.135819 18370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s user 0.020s sys 0.020s
W20260204 09:00:06.279909 18370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s user 0.020s sys 0.020s
I20260204 09:00:06.107879 20291 raft_consensus.cc:3055] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:00:06.140107 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:06.280567 20306 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.249775 18371 raft_consensus.cc:2393] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:06.280690 20291 raft_consensus.cc:740] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:06.250372 20265 raft_consensus.cc:515] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:06.282379 20291 consensus_queue.cc:260] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:06.283526 20291 raft_consensus.cc:3060] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:06.283795 20265 leader_election.cc:290] T a76dccca152648179027ee96bc473ad7 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:06.258860 20391 raft_consensus.cc:515] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:06.152180 19101 raft_consensus.cc:2410] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260204 09:00:06.093892 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:06.285470 18374 raft_consensus.cc:2410] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:06.155377 19108 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 09:00:06.286216 20391 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.253885 20400 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:06.286895 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.287583 19106 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:06.149605 20304 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:06.300313 19050 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.726s user 0.022s sys 0.032s
W20260204 09:00:06.300748 19050 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.726s user 0.022s sys 0.032s
W20260204 09:00:06.301025 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 829031us
W20260204 09:00:06.301942 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:06.301832 18417 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 09:00:06.302379 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:06.183455 18488 leader_election.cc:304] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:06.183744 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.304878 19109 raft_consensus.cc:2393] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 7: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:06.161360 20319 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:06.185113 18451 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
W20260204 09:00:06.169096 20080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s user 0.016s sys 0.024s
I20260204 09:00:06.159921 20378 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:06.256047 20294 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.224704 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:06.219789 18524 raft_consensus.cc:3060] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:06.223470 18517 raft_consensus.cc:3060] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Advancing to term 8
W20260204 09:00:06.186092 20395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.964s user 0.017s sys 0.024s
I20260204 09:00:06.177992 20320 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 09:00:06.185959 20375 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.728s user 0.017s sys 0.020s
I20260204 09:00:06.255518 19099 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
W20260204 09:00:06.316442 18416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s user 0.024s sys 0.042s
I20260204 09:00:06.259050 19100 rpcz_store.cc:276] 0204 09:00:04.765290 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.765417 (+ 127us) service_pool.cc:225] Handling call
0204 09:00:04.772690 (+ 7273us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:04.773014 (+ 324us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:04.773040 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:04.773546 (+ 506us) log.cc:844] Serialized 26 byte log entry
0204 09:00:05.856581 (+1083035us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:05.856617 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.856681 (+ 64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:06.129962 (+273281us) raft_consensus.cc:1685] finished
0204 09:00:06.129985 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.130110 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4266,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9893,"thread_start_us":1082689,"threads_started":1,"wal-append.queue_time_us":1354664}
I20260204 09:00:06.220480 18523 rpcz_store.cc:276] 0204 09:00:03.693819 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:03.693971 (+ 152us) service_pool.cc:225] Handling call
0204 09:00:03.723049 (+ 29078us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:03.723281 (+ 232us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:03.723310 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:04.500390 (+777080us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b2c0013bc98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb6ced9b1 00007fceb6cfcfe2 00007fceb842a851 00007fceb83ef0ba 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22
0204 09:00:04.505744 (+ 5354us) log.cc:844] Serialized 26 byte log entry
0204 09:00:05.702067 (+1196323us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:05.702110 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.702186 (+ 76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:06.108469 (+406283us) raft_consensus.cc:1685] finished
0204 09:00:06.108491 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.108691 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":78747392,"thread_start_us":1195946,"threads_started":1,"wal-append.queue_time_us":1562278}
I20260204 09:00:06.281111 18518 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 09:00:06.185518 20402 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:06.146399 20309 leader_election.cc:290] T c1f32c58bc4e422889e2b2739a3ca210 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:06.155471 18199 catalog_manager.cc:5654] T 2b5fa3c805c64abf9a473724f41a0f29 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:06.288717 19104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 856) took 1679 ms. Trace:
I20260204 09:00:06.288771 18448 raft_consensus.cc:2393] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 7: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
W20260204 09:00:06.146943 18491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s user 0.013s sys 0.034s
I20260204 09:00:06.292825 19108 raft_consensus.cc:2393] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 6: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
W20260204 09:00:06.315810 20080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s user 0.017s sys 0.025s
W20260204 09:00:06.305646 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 122284us
W20260204 09:00:06.308568 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:06.367483 18488 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
W20260204 09:00:06.367411 18491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s user 0.016s sys 0.035s
I20260204 09:00:06.295588 18521 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:06.250087 20078 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:06.313418 18446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s user 0.022s sys 0.044s
W20260204 09:00:06.377326 18446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s user 0.023s sys 0.044s
I20260204 09:00:06.281342 20377 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:06.149216 20299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.836s user 0.023s sys 0.046s
I20260204 09:00:06.323326 19106 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 8.
I20260204 09:00:06.250047 20355 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:06.362387 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 09:00:06.331509 18416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s user 0.025s sys 0.043s
I20260204 09:00:06.369125 18488 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:06.258098 20384 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.181382 19814 consensus_queue.cc:237] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:06.313365 18417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:06.290934 20193 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:06.344497 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:06.377496 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.457093 18343 leader_election.cc:304] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:06.388031 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.394760 18524 raft_consensus.cc:2468] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 7.
I20260204 09:00:06.315555 20314 raft_consensus.cc:2804] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260204 09:00:06.260496 20363 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:06.331353 20395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.102s user 0.017s sys 0.024s
I20260204 09:00:06.318251 20391 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:06.371264 20389 raft_consensus.cc:493] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:06.314709 20304 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:06.443931 20299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.110s user 0.024s sys 0.046s
I20260204 09:00:06.314457 19660 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.425177 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:06.396775 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.366525 19104 rpcz_store.cc:276] 0204 09:00:04.609187 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.609400 (+ 213us) service_pool.cc:225] Handling call
0204 09:00:04.629868 (+ 20468us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:04.630093 (+ 225us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:04.630119 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:04.630560 (+ 441us) log.cc:844] Serialized 26 byte log entry
0204 09:00:05.797427 (+1166867us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:05.797469 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.797539 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:06.288488 (+490949us) raft_consensus.cc:1685] finished
0204 09:00:06.288510 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.288646 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1166514,"threads_started":1,"wal-append.queue_time_us":1549609}
W20260204 09:00:06.450160 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:06.367702 20375 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.910s user 0.021s sys 0.021s
I20260204 09:00:06.452847 18417 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 09:00:06.521178 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 68420.5us
W20260204 09:00:06.522034 18373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s user 0.006s sys 0.007s
I20260204 09:00:06.366775 20265 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:06.458957 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:06.462982 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:06.421068 18517 raft_consensus.cc:2468] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 8.
I20260204 09:00:06.362754 20192 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:06.468568 18448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47928 (request call id 1027) took 1069 ms. Trace:
I20260204 09:00:06.395926 20135 raft_consensus.cc:493] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:06.452009 20380 consensus_queue.cc:1059] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260204 09:00:06.424011 20400 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 09:00:06.450073 20379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s user 0.011s sys 0.014s
W20260204 09:00:06.450151 18414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s user 0.002s sys 0.022s
I20260204 09:00:06.466584 20314 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:06.473182 20363 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.478941 19106 raft_consensus.cc:3055] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:06.399407 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:06.538194 19106 raft_consensus.cc:740] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
W20260204 09:00:06.508241 18443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s user 0.016s sys 0.008s
I20260204 09:00:06.324565 20378 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:06.540419 18443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s user 0.017s sys 0.008s
I20260204 09:00:06.521473 20078 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.323824 18525 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:06.409708 18199 catalog_manager.cc:5654] T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 4, leader changed from 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193) to c61e83e5fb7445e8bce7eca695977903 (127.15.3.195). New cstate: current_term: 4 leader_uuid: "c61e83e5fb7445e8bce7eca695977903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } }
I20260204 09:00:06.513644 19100 raft_consensus.cc:3060] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:06.455116 18446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 1024) took 1627 ms. Trace:
I20260204 09:00:06.367267 20320 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:06.550661 20430 log.cc:927] Time spent T 72802a089d72492ca11d2d83ae08413c P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260204 09:00:06.552048 20320 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:06.537501 20309 raft_consensus.cc:493] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:06.553649 20309 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:06.507810 20389 raft_consensus.cc:515] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.554999 20245 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.526926 18448 rpcz_store.cc:276] 0204 09:00:05.399185 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.467432 (+ 68247us) service_pool.cc:225] Handling call
0204 09:00:06.468337 (+1000905us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54005efbd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:06.468500 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1886443264}
I20260204 09:00:06.522593 19660 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.526670 20202 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:06.508261 18368 raft_consensus.cc:1240] T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:06.495136 20391 raft_consensus.cc:493] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:06.530786 18370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 332) took 1623 ms. Trace:
I20260204 09:00:06.605402 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:06.533982 18414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s user 0.002s sys 0.023s
W20260204 09:00:06.534260 18373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s user 0.006s sys 0.007s
W20260204 09:00:06.606585 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 981187us
I20260204 09:00:06.514496 18369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 342) took 1040 ms. Trace:
W20260204 09:00:06.500595 18519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60760 (request call id 737) took 2027 ms (client timeout 1627 ms). Trace:
I20260204 09:00:06.610756 18414 leader_election.cc:304] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:06.541438 18443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 423) took 1077 ms. Trace:
I20260204 09:00:06.612176 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:06.395663 20403 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
W20260204 09:00:06.537400 20329 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s user 0.016s sys 0.000s
W20260204 09:00:06.613926 18377 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s user 0.000s sys 0.030s
W20260204 09:00:06.618110 18377 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s user 0.000s sys 0.030s
I20260204 09:00:06.547570 18446 rpcz_store.cc:276] 0204 09:00:04.828242 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.053571 (+225329us) service_pool.cc:225] Handling call
0204 09:00:05.174977 (+121406us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:06.377805 (+1202828us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:06.377838 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:06.377886 (+ 48us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:06.377915 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.454883 (+ 76968us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540010efd4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:06.454937 (+ 54us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.455061 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13539,"raft.queue_time_us":63818,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11510,"spinlock_wait_cycles":1012163456,"thread_start_us":741578,"threads_started":1}
I20260204 09:00:06.531899 20135 raft_consensus.cc:515] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:06.556102 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:06.555545 20309 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:06.556330 20402 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 09:00:06.616122 20434 log.cc:927] Time spent T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.065s user 0.001s sys 0.000s
W20260204 09:00:06.537235 20379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s user 0.014s sys 0.014s
I20260204 09:00:06.545111 19106 consensus_queue.cc:260] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:06.529505 20282 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:06.605309 18370 rpcz_store.cc:276] 0204 09:00:04.907865 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.908349 (+ 484us) service_pool.cc:225] Handling call
0204 09:00:04.951197 (+ 42848us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:04.951555 (+ 358us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:04.951584 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:04.952091 (+ 507us) log.cc:844] Serialized 26 byte log entry
0204 09:00:06.280317 (+1328226us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:06.280362 (+ 45us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.280444 (+ 82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:06.530538 (+250094us) raft_consensus.cc:1685] finished
0204 09:00:06.530561 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.530724 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1988,"raft.queue_time_us":4848,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":49125,"thread_start_us":1033888,"threads_started":1,"wal-append.queue_time_us":1445473}
W20260204 09:00:06.666322 18375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s user 0.012s sys 0.025s
W20260204 09:00:06.507917 20392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s user 0.007s sys 0.025s
I20260204 09:00:06.613209 18448 raft_consensus.cc:2468] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 2.
I20260204 09:00:06.540573 20314 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:06.618822 18414 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:06.579893 20400 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.556787 20380 raft_consensus.cc:3055] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Stepping down as leader of term 2
I20260204 09:00:06.547791 18199 catalog_manager.cc:5654] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 2 to 3, leader changed from 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196) to 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193). New cstate: current_term: 3 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } }
I20260204 09:00:06.612522 18443 rpcz_store.cc:276] 0204 09:00:05.464329 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.853021 (+388692us) service_pool.cc:225] Handling call
0204 09:00:05.853337 (+ 316us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:05.853562 (+ 225us) raft_consensus.cc:1534] Early marking committed up to index 4
0204 09:00:05.874167 (+ 20605us) log.cc:844] Serialized 14 byte log entry
0204 09:00:06.540902 (+666735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:06.541165 (+ 263us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:06.541207 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.541273 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.541390 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37659,"prepare.queue_time_us":21000,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":99,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":666389,"threads_started":1}
W20260204 09:00:06.602455 19988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s user 0.011s sys 0.019s
W20260204 09:00:06.609776 20428 log.cc:927] Time spent T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.091s user 0.000s sys 0.001s
I20260204 09:00:06.507159 20288 raft_consensus.cc:2804] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader election won for term 8
I20260204 09:00:06.563573 20389 leader_election.cc:290] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:06.556344 20375 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.630074 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.606583 20202 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:06.531899 20192 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:06.610184 20406 log.cc:927] Time spent T a43a955d03304c0b847a09e4d430afc1 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.057s user 0.001s sys 0.000s
W20260204 09:00:06.610354 20427 log.cc:927] Time spent T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260204 09:00:06.560928 20378 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.552110 20435 raft_consensus.cc:2749] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:06.530021 20265 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.610064 20391 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:06.618431 20429 log.cc:927] Time spent T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.143s user 0.000s sys 0.000s
W20260204 09:00:06.713992 19107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s user 0.009s sys 0.019s
W20260204 09:00:06.714454 19107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s user 0.009s sys 0.020s
W20260204 09:00:06.623111 20373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s user 0.005s sys 0.010s
I20260204 09:00:06.637953 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:06.539186 20425 consensus_queue.cc:1059] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260204 09:00:06.458784 20355 raft_consensus.cc:515] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.610519 20358 leader_election.cc:290] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:06.687186 20400 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:06.670534 18375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s user 0.012s sys 0.025s
I20260204 09:00:06.673985 19106 raft_consensus.cc:3060] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:06.674144 19100 raft_consensus.cc:2468] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:06.564136 20078 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:06.615868 20329 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s user 0.016s sys 0.000s
I20260204 09:00:06.652199 18451 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:06.337312 20294 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.678303 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:06.768792 18448 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:06.769692 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:06.678282 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 59555us
W20260204 09:00:06.639477 18447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s user 0.006s sys 0.005s
W20260204 09:00:06.774230 18447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s user 0.008s sys 0.010s
W20260204 09:00:06.633317 20258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s user 0.003s sys 0.009s
I20260204 09:00:06.682112 18199 catalog_manager.cc:5654] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "354a648f08a44b98a7f93d74b0ea93ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } health_report { overall_health: UNKNOWN } } }
I20260204 09:00:06.685643 20319 raft_consensus.cc:515] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:06.669111 20392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.023s user 0.008s sys 0.025s
W20260204 09:00:06.665841 20287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s user 0.001s sys 0.010s
I20260204 09:00:06.690608 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:06.668532 20309 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:06.693393 18340 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.603s user 0.032s sys 0.015s
W20260204 09:00:06.609885 18519 rpcz_store.cc:269] 0204 09:00:04.454215 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.460500 (+ 6285us) service_pool.cc:225] Handling call
0204 09:00:06.451691 (+1991191us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400642654. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:06.469024 (+ 17333us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3353691392}
W20260204 09:00:06.686544 19988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s user 0.011s sys 0.020s
I20260204 09:00:06.637624 18368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 334) took 1723 ms. Trace:
I20260204 09:00:06.623229 20403 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:06.699435 18450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s user 0.006s sys 0.007s
W20260204 09:00:06.679255 19964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s user 0.006s sys 0.010s
I20260204 09:00:06.705286 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:06.679739 20380 raft_consensus.cc:740] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:06.710456 19105 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 8.
I20260204 09:00:06.639171 20402 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:06.712900 19102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s user 0.005s sys 0.010s
I20260204 09:00:06.676635 20282 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:06.610049 18369 rpcz_store.cc:276] 0204 09:00:05.468861 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.882411 (+413550us) service_pool.cc:225] Handling call
0204 09:00:05.904440 (+ 22029us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:06.177750 (+273310us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.456166 (+278416us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001fa254. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:06.509238 (+ 53072us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":442539264}
I20260204 09:00:06.732316 18446 raft_consensus.cc:2393] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
W20260204 09:00:06.732544 20373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s user 0.005s sys 0.010s
W20260204 09:00:06.720283 20390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s user 0.029s sys 0.016s
W20260204 09:00:06.730508 19745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s user 0.017s sys 0.032s
I20260204 09:00:06.697947 20202 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:06.696825 20288 raft_consensus.cc:697] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:06.618743 20398 raft_consensus.cc:3060] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
W20260204 09:00:06.720062 20401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s user 0.005s sys 0.010s
I20260204 09:00:06.763711 18343 leader_election.cc:304] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:06.767060 18444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 770) took 2054 ms. Trace:
I20260204 09:00:06.776084 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:06.941823 18417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:06.909102 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 539998us
W20260204 09:00:06.908766 18491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s user 0.033s sys 0.030s
W20260204 09:00:06.943413 18491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s user 0.035s sys 0.031s
I20260204 09:00:06.809903 18448 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 7.
I20260204 09:00:06.783557 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:06.940959 18444 rpcz_store.cc:276] 0204 09:00:04.712250 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.904974 (+192724us) service_pool.cc:225] Handling call
0204 09:00:04.955518 (+ 50544us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:05.018845 (+ 63327us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:05.018874 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:05.037993 (+ 19119us) log.cc:844] Serialized 26 byte log entry
0204 09:00:05.992923 (+954930us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:05.992966 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:05.993036 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:06.766848 (+773812us) raft_consensus.cc:1685] finished
0204 09:00:06.766871 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.767001 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62933,"raft.queue_time_us":82326,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":13149,"thread_start_us":798109,"threads_started":1,"wal-append.queue_time_us":1389650}
I20260204 09:00:06.941300 19099 raft_consensus.cc:2468] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:06.757480 20304 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:06.760306 20435 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.885481 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:06.780109 18375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 333) took 1872 ms. Trace:
I20260204 09:00:06.698457 20375 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.941594 18521 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 09:00:06.908071 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:06.886642 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:06.911906 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:06.946693 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 183714us
I20260204 09:00:06.833176 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:06.947556 19102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s user 0.007s sys 0.016s
W20260204 09:00:06.947912 18340 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.858s user 0.040s sys 0.015s
W20260204 09:00:06.984356 18450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s user 0.013s sys 0.011s
I20260204 09:00:07.030382 18518 raft_consensus.cc:2393] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:07.030697 18524 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:07.030524 18517 raft_consensus.cc:2468] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
W20260204 09:00:06.782209 20258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s user 0.004s sys 0.009s
W20260204 09:00:06.940701 19050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s user 0.007s sys 0.004s
W20260204 09:00:07.035135 19050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s user 0.008s sys 0.004s
I20260204 09:00:06.756951 20193 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:06.834319 20427 log.cc:927] Time spent T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20260204 09:00:06.769806 20358 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 09:00:06.946380 19745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s user 0.021s sys 0.032s
W20260204 09:00:06.833176 20293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.012s sys 0.017s
I20260204 09:00:07.033242 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:06.781747 20321 raft_consensus.cc:2749] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 09:00:07.031635 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 941872us
I20260204 09:00:06.994367 20371 raft_consensus.cc:2804] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:06.875216 18442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 769) took 2163 ms. Trace:
I20260204 09:00:07.030603 18374 raft_consensus.cc:2393] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 3: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:06.989624 18488 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 09:00:07.064610 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 75081.4us
I20260204 09:00:07.065490 18488 leader_election.cc:304] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:06.993603 20439 raft_consensus.cc:493] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:07.037679 18517 raft_consensus.cc:1240] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260204 09:00:06.945772 20401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s user 0.005s sys 0.014s
I20260204 09:00:07.031431 18375 rpcz_store.cc:276] 0204 09:00:04.908164 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.908477 (+ 313us) service_pool.cc:225] Handling call
0204 09:00:04.952436 (+ 43959us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:04.952638 (+ 202us) raft_consensus.cc:1534] Early marking committed up to index 4
0204 09:00:05.856583 (+903945us) log.cc:844] Serialized 14 byte log entry
0204 09:00:06.779403 (+922820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:06.779463 (+ 60us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:06.779507 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.779570 (+ 63us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.780051 (+ 481us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1127295,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":15993,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":22575,"thread_start_us":1744414,"threads_started":2,"wal-append.queue_time_us":1098922}
I20260204 09:00:07.041966 20320 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:07.052645 20293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s user 0.012s sys 0.018s
I20260204 09:00:06.781364 20080 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 09:00:06.950641 19964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s user 0.009s sys 0.016s
W20260204 09:00:07.042670 19108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s user 0.000s sys 0.011s
I20260204 09:00:06.932452 20389 raft_consensus.cc:493] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.861876 19660 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:06.950819 20442 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.781792 19893 consensus_queue.cc:1059] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.273s
I20260204 09:00:06.951327 20291 raft_consensus.cc:493] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:06.987963 20440 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.833554 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:06.950914 20135 leader_election.cc:290] T f9d6ad3406784527a0e5f590724f204e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:06.986845 20377 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:06.979292 20392 raft_consensus.cc:697] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 09:00:07.065596 19051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s user 0.023s sys 0.029s
I20260204 09:00:07.066823 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:07.068086 18442 rpcz_store.cc:276] 0204 09:00:04.711963 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.860723 (+148760us) service_pool.cc:225] Handling call
0204 09:00:04.893693 (+ 32970us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:05.056584 (+162891us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:05.056616 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:05.174350 (+117734us) log.cc:844] Serialized 26 byte log entry
0204 09:00:05.982020 (+807670us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:05.982074 (+ 54us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.045210 (+ 63136us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400370854. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:06.045266 (+ 56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:06.854766 (+809500us) raft_consensus.cc:1685] finished
0204 09:00:06.854791 (+ 25us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:06.875141 (+ 20350us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28371,"raft.queue_time_us":28998,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10555,"spinlock_wait_cycles":285201792,"thread_start_us":733172,"threads_started":1,"wal-append.queue_time_us":1124304}
W20260204 09:00:07.037477 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 615007us
W20260204 09:00:07.070127 19052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s user 0.004s sys 0.011s
W20260204 09:00:07.453774 19051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s user 0.023s sys 0.029s
W20260204 09:00:06.942430 20390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s user 0.029s sys 0.020s
I20260204 09:00:07.078289 18525 raft_consensus.cc:1240] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 LEADER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
I20260204 09:00:07.458753 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:07.459335 18525 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:07.460273 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d40b352c1b54b1e875dc8a41b09f865" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:07.461372 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:07.083846 18521 raft_consensus.cc:1240] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:07.433122 20403 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:07.085448 15375 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260204 09:00:06.946385 20287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.972s user 0.003s sys 0.017s
W20260204 09:00:07.101361 19101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s user 0.003s sys 0.014s
I20260204 09:00:07.499214 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a4f4307728d44029b19b3b03f406068" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:07.501844 18521 raft_consensus.cc:2393] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 6: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:07.502767 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:07.503930 19101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.034s user 0.007s sys 0.021s
I20260204 09:00:07.504690 19101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 876) took 1211 ms. Trace:
I20260204 09:00:07.505030 19101 rpcz_store.cc:276] 0204 09:00:06.293458 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:06.458325 (+164867us) service_pool.cc:225] Handling call
0204 09:00:06.458661 (+ 336us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:07.504326 (+1045665us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:07.504358 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:07.504417 (+ 59us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:07.504447 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:07.504509 (+ 62us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.504636 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":85494,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":1033869,"threads_started":1}
I20260204 09:00:07.047879 20299 raft_consensus.cc:493] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:07.320175 20453 log.cc:927] Time spent T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.281s user 0.000s sys 0.001s
I20260204 09:00:06.985206 18368 rpcz_store.cc:276] 0204 09:00:04.912300 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.920258 (+ 7958us) service_pool.cc:225] Handling call
0204 09:00:05.064747 (+144489us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:06.613406 (+1548659us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.618244 (+ 4838us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400534b54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:06.635391 (+ 17147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3192442240}
I20260204 09:00:07.339457 20384 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:07.452033 20446 log.cc:927] Time spent T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.390s user 0.001s sys 0.001s
I20260204 09:00:07.306878 20319 leader_election.cc:290] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 09:00:07.411461 18376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34974 (request call id 335) took 2457 ms (client timeout 2435 ms). Trace:
I20260204 09:00:07.517409 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:07.517287 18376 rpcz_store.cc:269] 0204 09:00:04.920582 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.920730 (+ 148us) service_pool.cc:225] Handling call
0204 09:00:07.378077 (+2457347us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540029ead4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:07.378247 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4490139392}
I20260204 09:00:07.452824 20375 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 09:00:07.310146 20447 log.cc:927] Time spent T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.476s user 0.000s sys 0.001s
I20260204 09:00:07.195587 18445 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903 [term 7 LEADER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:07.373687 19102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 866) took 1309 ms. Trace:
I20260204 09:00:07.525462 19102 rpcz_store.cc:276] 0204 09:00:06.064756 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:06.064933 (+ 177us) service_pool.cc:225] Handling call
0204 09:00:06.088392 (+ 23459us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:06.088607 (+ 215us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 09:00:06.099307 (+ 10700us) log.cc:844] Serialized 14 byte log entry
0204 09:00:06.121919 (+ 22612us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18003bff80. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fcebe19dc91 00007fcebe1aa671 00007fceb5323c67 00007fcebe114709 00007fceb534057b 00007fceb533e81f 00007fceb5340ae2 00007fceb7f885ab 00007fceb7f8e0c3 00007fceb7f8e5da 00007fceb83f96aa
0204 09:00:07.031075 (+909156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:07.031128 (+ 53us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:07.031166 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:07.031229 (+ 63us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.373460 (+342231us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b5400261e50. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83ee52d 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:07.373613 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4480,"prepare.queue_time_us":8284,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":14089,"raft.queue_time_us":93,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10118,"spinlock_wait_cycles":83675136,"thread_start_us":908876,"threads_started":1,"wal-append.queue_time_us":1050190}
W20260204 09:00:07.527228 18491 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.3.193:33867 timed out after 1.678s (SENT) [suppressed 11 similar messages]
I20260204 09:00:07.078668 20358 raft_consensus.cc:493] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:07.303284 18516 raft_consensus.cc:1240] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: []
W20260204 09:00:07.311973 20441 log.cc:927] Time spent T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.508s user 0.001s sys 0.000s
I20260204 09:00:07.200809 20080 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:07.096141 18369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:07.275533 20400 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:07.284288 20477 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260204 09:00:07.128635 19108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s user 0.001s sys 0.011s
I20260204 09:00:07.263561 20355 leader_election.cc:290] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:07.216758 18450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 426) took 1724 ms. Trace:
W20260204 09:00:07.139945 20306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s user 0.011s sys 0.006s
W20260204 09:00:07.074319 19814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s user 0.003s sys 0.013s
I20260204 09:00:07.421458 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34974 (request call id 341) took 1954 ms. Trace:
I20260204 09:00:07.563127 18377 rpcz_store.cc:276] 0204 09:00:05.466581 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.876680 (+410099us) service_pool.cc:225] Handling call
0204 09:00:05.877040 (+ 360us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:05.877255 (+ 215us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 09:00:06.620604 (+743349us) log.cc:844] Serialized 14 byte log entry
0204 09:00:07.032323 (+411719us) log.cc:844] Serialized 14 byte log entry
0204 09:00:07.420456 (+388133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:07.420996 (+ 540us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:07.421044 (+ 48us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:07.421120 (+ 76us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.421389 (+ 269us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55360,"prepare.queue_time_us":204201,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":112983,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":106012,"spinlock_wait_cycles":138421120,"thread_start_us":1385372,"threads_started":3,"wal-append.queue_time_us":718712}
I20260204 09:00:07.352648 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f846ea1dc8409290d5635d9ec149d0" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:07.173136 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:07.297313 20294 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:07.289143 20078 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:07.094563 20439 raft_consensus.cc:515] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:07.541244 20477 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:07.575162 20477 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:07.575683 20483 log.cc:927] Time spent T d17b9b554db3494a9c6594df37a1ab2f P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
I20260204 09:00:07.576508 20439 leader_election.cc:290] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:07.161600 18449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 1015) took 3050 ms. Trace:
I20260204 09:00:07.038085 20435 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:06.988670 20309 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:07.306370 20373 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:07.257174 20265 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:07.196146 18517 raft_consensus.cc:1275] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260204 09:00:07.313095 19745 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:07.321980 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 240382us
I20260204 09:00:07.275153 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:07.066165 20380 consensus_queue.cc:260] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:07.135875 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:07.431238 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 388820us
I20260204 09:00:07.432209 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:07.592370 18523 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:07.176301 20192 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:07.311519 20466 raft_consensus.cc:2804] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260204 09:00:07.422137 20462 log.cc:927] Time spent T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.171s user 0.000s sys 0.000s
W20260204 09:00:07.377521 20452 log.cc:927] Time spent T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.440s user 0.001s sys 0.001s
I20260204 09:00:07.448653 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:07.365676 20444 log.cc:927] Time spent T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.478s user 0.000s sys 0.001s
W20260204 09:00:07.444497 20450 log.cc:927] Time spent T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.401s user 0.001s sys 0.000s
I20260204 09:00:07.143743 20288 consensus_queue.cc:237] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:07.454783 19052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s user 0.005s sys 0.011s
I20260204 09:00:07.389639 20282 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:07.377737 20402 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:07.602965 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 75777.3us
I20260204 09:00:07.422437 20382 raft_consensus.cc:493] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 09:00:07.457288 20476 log.cc:927] Time spent T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
I20260204 09:00:07.067691 18414 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 09:00:07.604322 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 536714us
I20260204 09:00:07.410480 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:07.593839 20373 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:07.606037 20400 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:07.606747 20373 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:07.606573 20400 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:07.606914 18447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47928 (request call id 1025) took 2208 ms. Trace:
W20260204 09:00:07.607908 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:07.607525 20382 raft_consensus.cc:515] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:07.608771 20380 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:07.609437 20400 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 09:00:07.608471 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:07.607298 18447 rpcz_store.cc:276] 0204 09:00:05.398660 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.862414 (+463754us) service_pool.cc:225] Handling call
0204 09:00:05.878665 (+ 16251us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:05.879003 (+ 338us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:05.879031 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:05.884433 (+ 5402us) log.cc:844] Serialized 26 byte log entry
0204 09:00:06.774607 (+890174us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:06.774647 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.774733 (+ 86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:07.606681 (+831948us) raft_consensus.cc:1685] finished
0204 09:00:07.606702 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.606857 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1977,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10310,"thread_start_us":834186,"threads_started":1,"wal-append.queue_time_us":970576}
I20260204 09:00:07.613263 19102 raft_consensus.cc:1240] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 6. Current term is 7. Ops: []
W20260204 09:00:07.460156 20449 log.cc:927] Time spent T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.163s user 0.000s sys 0.000s
I20260204 09:00:07.513582 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "263a60191abd44948307685e71fc6321" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:07.614984 19105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:07.514438 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:07.514340 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:07.613816 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:07.615427 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:07.319015 20423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s user 0.007s sys 0.001s
I20260204 09:00:07.522445 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:07.528965 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:07.516215 20460 log.cc:927] Time spent T f93610353fcc43beabd7d2cf48df6a80 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.436s user 0.001s sys 0.000s
I20260204 09:00:07.620397 18516 raft_consensus.cc:2393] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 6: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:07.621114 20435 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:07.621222 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:07.621924 18516 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 09:00:07.453752 20371 raft_consensus.cc:697] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
W20260204 09:00:07.533563 20472 log.cc:927] Time spent T e65e67a60cd24f02a3f66afc76e2b5f0 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.111s user 0.000s sys 0.000s
I20260204 09:00:07.445255 20389 raft_consensus.cc:515] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:07.541802 19108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 878) took 1091 ms. Trace:
I20260204 09:00:07.451515 20291 raft_consensus.cc:515] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:07.541838 18450 rpcz_store.cc:276] 0204 09:00:05.491999 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.901860 (+409861us) service_pool.cc:225] Handling call
0204 09:00:05.924080 (+ 22220us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:05.924318 (+ 238us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 09:00:05.990473 (+ 66155us) log.cc:844] Serialized 14 byte log entry
0204 09:00:07.216364 (+1225891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:07.216429 (+ 65us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:07.216476 (+ 47us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:07.216548 (+ 72us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.216693 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22690,"prepare.queue_time_us":95188,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2231,"raft.queue_time_us":260100,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9470,"spinlock_wait_cycles":27968896,"thread_start_us":1225478,"threads_started":2,"wal-append.queue_time_us":1072456}
W20260204 09:00:07.530563 20445 log.cc:927] Time spent T f9d6ad3406784527a0e5f590724f204e P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.228s user 0.000s sys 0.001s
I20260204 09:00:07.568504 18374 raft_consensus.cc:1240] T ba427f707a5a42fb975b3a3ee7215aa6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260204 09:00:07.461611 20377 raft_consensus.cc:515] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:07.310461 20456 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:07.455955 20440 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:07.513880 20299 raft_consensus.cc:515] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:07.560552 20306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s user 0.015s sys 0.015s
I20260204 09:00:07.579887 18449 rpcz_store.cc:276] 0204 09:00:04.110897 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:04.111065 (+ 168us) service_pool.cc:225] Handling call
0204 09:00:04.140109 (+ 29044us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:05.017622 (+877513us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:05.017672 (+ 50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:05.028646 (+ 10974us) log.cc:844] Serialized 26 byte log entry
0204 09:00:05.893218 (+864572us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:06.370823 (+477605us) log.cc:844] Serialized 14 byte log entry
0204 09:00:06.371125 (+ 302us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.371441 (+ 316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:07.126692 (+755251us) raft_consensus.cc:1685] finished
0204 09:00:07.126718 (+ 26us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.161523 (+ 34805us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":34932,"prepare.queue_time_us":53636,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":177041,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":44871,"thread_start_us":2000182,"threads_started":3,"wal-append.queue_time_us":1409006}
W20260204 09:00:07.562531 19814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s user 0.005s sys 0.015s
I20260204 09:00:07.587090 19745 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:07.460357 20392 consensus_queue.cc:237] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:07.597240 18522 raft_consensus.cc:2468] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:07.451665 20442 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:07.598816 18488 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:07.592584 18369 raft_consensus.cc:2393] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 4: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
W20260204 09:00:07.455170 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:07.605057 18371 raft_consensus.cc:3060] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:07.463145 19050 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
W20260204 09:00:07.512660 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 208401us
I20260204 09:00:07.614264 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:07.640244 19107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 865) took 1576 ms. Trace:
I20260204 09:00:07.097977 20320 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:07.615523 18375 raft_consensus.cc:2468] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 09:00:07.616390 18521 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
W20260204 09:00:07.685878 20470 log.cc:927] Time spent T 6997ab65a1f44cd18707ec9e0afa05e9 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.051s user 0.004s sys 0.001s
I20260204 09:00:07.686939 20320 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 09:00:07.687734 20391 consensus_meta.cc:287] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.930s user 0.011s sys 0.000s
I20260204 09:00:07.617033 18491 leader_election.cc:304] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:07.595664 20294 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:07.613736 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:07.616839 18370 raft_consensus.cc:3060] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
W20260204 09:00:07.619817 20423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s user 0.010s sys 0.001s
I20260204 09:00:07.623723 18373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 1018) took 2196 ms. Trace:
I20260204 09:00:07.624626 18343 leader_election.cc:304] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:07.625334 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:07.625790 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:07.608431 20314 consensus_meta.cc:287] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.921s user 0.007s sys 0.003s
I20260204 09:00:07.539901 20358 raft_consensus.cc:515] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:07.626574 18414 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:07.595053 20466 raft_consensus.cc:493] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:07.608358 20375 raft_consensus.cc:493] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:07.628599 18442 raft_consensus.cc:2410] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:07.628841 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:07.628578 19108 rpcz_store.cc:276] 0204 09:00:06.449983 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:06.514587 (+ 64604us) service_pool.cc:225] Handling call
0204 09:00:06.514923 (+ 336us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:07.541440 (+1026517us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:07.541472 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:07.541518 (+ 46us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:07.541547 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:07.541611 (+ 64us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.541747 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":46584,"raft.queue_time_us":41005,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":49,"thread_start_us":1026116,"threads_started":1}
I20260204 09:00:07.630755 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:07.617498 20384 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:00:07.680367 19107 rpcz_store.cc:276] 0204 09:00:06.063639 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:06.064422 (+ 783us) service_pool.cc:225] Handling call
0204 09:00:06.094260 (+ 29838us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:06.094572 (+ 312us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:06.094602 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:06.114080 (+ 19478us) log.cc:844] Serialized 26 byte log entry
0204 09:00:06.714905 (+600825us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:06.714948 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.715020 (+ 72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:07.640004 (+924984us) raft_consensus.cc:1685] finished
0204 09:00:07.640034 (+ 30us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.640183 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":58396,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":5786,"thread_start_us":564225,"threads_started":1,"wal-append.queue_time_us":912682}
I20260204 09:00:07.682145 19099 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:07.662112 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:07.658885 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:07.680313 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 217211us
I20260204 09:00:07.683295 18340 leader_election.cc:304] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 09:00:07.684211 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 85479.5us
I20260204 09:00:07.616643 18525 raft_consensus.cc:2393] T d7c5f3d791434f71a1cc75df662bd3c6 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 7: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:07.628334 20078 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:07.630990 20439 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
W20260204 09:00:07.695789 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 78836us
I20260204 09:00:08.269023 19101 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
W20260204 09:00:08.270862 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 646279us
I20260204 09:00:08.271370 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:07.762382 18523 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:08.274698 18523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52184 (request call id 356) took 1232 ms. Trace:
I20260204 09:00:08.274605 19101 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 2.
I20260204 09:00:08.277536 18491 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
W20260204 09:00:08.281602 18368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s user 0.012s sys 0.008s
W20260204 09:00:08.282066 18368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s user 0.012s sys 0.008s
I20260204 09:00:08.269963 18517 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:08.276791 20493 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:08.278051 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:07.700269 19104 raft_consensus.cc:3055] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:08.283535 19104 raft_consensus.cc:740] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
W20260204 09:00:08.216639 19051 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:07.701489 20440 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.284442 19104 consensus_queue.cc:260] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.277560 20314 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.286140 19050 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:08.286262 20299 leader_election.cc:290] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.287287 18488 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:08.285593 19104 raft_consensus.cc:3060] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:08.288282 20466 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:08.287521 20314 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 8 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.293226 20442 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:07.840615 20475 log.cc:927] Time spent T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.216s user 0.000s sys 0.001s
I20260204 09:00:07.774555 18371 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 8.
W20260204 09:00:08.294540 18371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45722 (request call id 837) took 1511 ms (client timeout 2000 ms). Trace:
W20260204 09:00:08.295037 18371 rpcz_store.cc:269] 0204 09:00:06.782853 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.171346 (+388493us) service_pool.cc:225] Handling call
0204 09:00:08.294472 (+1123126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:08.275496 18523 rpcz_store.cc:276] 0204 09:00:07.042006 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.042127 (+ 121us) service_pool.cc:225] Handling call
0204 09:00:08.274639 (+1232512us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:08.283175 20493 raft_consensus.cc:515] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:08.297600 20493 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:08.298274 20493 consensus_queue.cc:1048] T c2817d87504042fba8cda4e4e352c571 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:08.285048 20377 leader_election.cc:290] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.286270 18524 raft_consensus.cc:1240] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 8. Ops: []
I20260204 09:00:08.299630 20493 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:08.300105 20493 raft_consensus.cc:515] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:08.278144 19106 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:08.293848 20314 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:08.294668 20494 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260204 09:00:08.281370 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:08.278757 20078 raft_consensus.cc:515] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:08.279956 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:07.702445 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.366842 19102 raft_consensus.cc:2410] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260204 09:00:07.702749 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:08.366317 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 683013us
W20260204 09:00:07.781509 20474 log.cc:927] Time spent T 10a6d690ab964c9892bfdda747cf6fc0 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.182s user 0.000s sys 0.000s
I20260204 09:00:08.409888 19102 raft_consensus.cc:1275] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 9 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260204 09:00:08.368223 19109 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:08.412756 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:07.634981 20389 leader_election.cc:290] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:07.704193 20435 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:08.363034 18376 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 7.
I20260204 09:00:08.272717 18373 rpcz_store.cc:276] 0204 09:00:05.427806 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.428613 (+ 807us) service_pool.cc:225] Handling call
0204 09:00:05.435190 (+ 6577us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:05.696542 (+261352us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:05.696577 (+ 35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:05.705511 (+ 8934us) log.cc:844] Serialized 26 byte log entry
0204 09:00:06.607204 (+901693us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:06.607247 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:06.617621 (+ 10374us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400378f54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:06.645011 (+ 27390us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:07.623426 (+978415us) raft_consensus.cc:1685] finished
0204 09:00:07.623455 (+ 29us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:07.623664 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22499,"raft.queue_time_us":2300,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8384,"spinlock_wait_cycles":578387712,"thread_start_us":840469,"threads_started":1,"wal-append.queue_time_us":1007214}
I20260204 09:00:08.420511 19099 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:08.285507 20440 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:08.422053 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.427356 19108 raft_consensus.cc:2468] T cf58feb0b26e413a84bdd849dedcaa81 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:07.636327 20309 leader_election.cc:290] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:08.338423 20484 raft_consensus.cc:2804] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260204 09:00:08.433449 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 122600us
I20260204 09:00:08.438247 18370 raft_consensus.cc:2468] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 7.
W20260204 09:00:08.438961 18370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45722 (request call id 842) took 1531 ms (client timeout 1882 ms). Trace:
I20260204 09:00:08.170572 19745 leader_election.cc:290] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:07.738171 20319 raft_consensus.cc:2749] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 09:00:08.421432 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 134226us
I20260204 09:00:08.443759 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.444434 19108 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 2.
I20260204 09:00:08.414481 20377 raft_consensus.cc:2804] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260204 09:00:08.363693 20477 consensus_meta.cc:287] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 0.788s user 0.014s sys 0.005s
I20260204 09:00:07.839715 20321 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:07.683864 20471 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260204 09:00:07.694201 20456 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:07.720636 20202 consensus_meta.cc:287] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.726s user 0.008s sys 0.002s
I20260204 09:00:08.362969 20494 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 09:00:08.369072 20398 consensus_meta.cc:287] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 1.381s user 0.001s sys 0.010s
W20260204 09:00:08.439623 18370 rpcz_store.cc:269] 0204 09:00:06.907187 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.465015 (+557828us) service_pool.cc:225] Handling call
0204 09:00:08.438893 (+973878us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:08.013983 20479 raft_consensus.cc:493] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
W20260204 09:00:08.448700 18488 connection.cc:232] RPC call timeout handler was delayed by -2.3210295720000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260204 09:00:08.337775 20375 raft_consensus.cc:515] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:08.449143 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 163079us
I20260204 09:00:08.446323 20377 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:07.710695 20391 raft_consensus.cc:515] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:07.700842 20378 raft_consensus.cc:3055] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Stepping down as leader of term 4
I20260204 09:00:08.338047 20294 raft_consensus.cc:515] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.452404 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:08.457710 19104 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.433090 20484 raft_consensus.cc:493] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:08.440326 20435 raft_consensus.cc:697] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:08.415738 20439 raft_consensus.cc:515] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:08.462146 18376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:08.463459 18370 raft_consensus.cc:1275] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 9 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260204 09:00:08.464879 19108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:07.867923 20371 consensus_queue.cc:237] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:08.455961 20321 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:08.467931 20497 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:08.505311 20497 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:08.506552 20321 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:08.476212 20498 raft_consensus.cc:493] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:08.507906 20498 raft_consensus.cc:515] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:08.477371 20391 leader_election.cc:290] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.468794 20378 raft_consensus.cc:740] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:08.478943 20496 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:08.478451 20466 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.489106 20398 raft_consensus.cc:2749] T a76dccca152648179027ee96bc473ad7 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:08.499419 18377 raft_consensus.cc:2393] T d7c5f3d791434f71a1cc75df662bd3c6 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 7: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:08.459550 20494 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:08.451023 20477 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.478412 20471 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260204 09:00:08.510949 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 884362us
I20260204 09:00:08.511509 19105 raft_consensus.cc:2410] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260204 09:00:08.513103 18376 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "64ea22ea98194ddba012eb97da4ef833"
dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
mode: GRACEFUL
new_leader_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
from {username='slave'} at 127.0.0.1:34972
I20260204 09:00:08.466593 20377 raft_consensus.cc:3060] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:08.516264 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:08.524626 18370 raft_consensus.cc:2468] T 5d8340499d764f8cb6e95f63db6fb29f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:08.525120 18414 leader_election.cc:304] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:08.507385 20497 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:08.516526 19101 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:08.451741 18368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45722 (request call id 835) took 1678 ms. Trace:
I20260204 09:00:08.514776 19050 leader_election.cc:304] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:08.459342 20202 raft_consensus.cc:515] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.528354 18414 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:08.464052 20319 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:08.466786 20479 raft_consensus.cc:515] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:08.502321 20484 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:08.529786 18414 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:08.538125 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.528393 20492 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:08.542339 18491 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:08.524852 20471 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:08.517866 20378 consensus_queue.cc:260] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.531960 20391 raft_consensus.cc:2804] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:08.530499 20321 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:08.562122 18448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47922 (request call id 781) took 1950 ms. Trace:
I20260204 09:00:08.562646 18448 rpcz_store.cc:276] 0204 09:00:06.611942 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:06.769426 (+157484us) service_pool.cc:225] Handling call
0204 09:00:08.561912 (+1792486us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b54002a3854. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:08.562057 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":90911104}
I20260204 09:00:08.543339 20442 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:08.518433 20496 raft_consensus.cc:515] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:08.572795 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 201725us
I20260204 09:00:08.552667 18520 raft_consensus.cc:1240] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6. Ops: []
W20260204 09:00:08.552799 20486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s user 0.008s sys 0.028s
I20260204 09:00:08.592795 18340 leader_election.cc:304] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:08.555948 20471 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:08.545735 20497 consensus_queue.cc:1059] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260204 09:00:08.539776 20319 raft_consensus.cc:515] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:08.559286 20391 raft_consensus.cc:493] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:08.546764 20492 raft_consensus.cc:515] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:08.608604 18376 raft_consensus.cc:606] T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 LEADER]: Received request to transfer leadership to TS 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:08.589972 20378 raft_consensus.cc:3060] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Advancing to term 5
W20260204 09:00:08.599540 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 59128.3us
W20260204 09:00:08.608016 20486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s user 0.008s sys 0.029s
I20260204 09:00:08.594218 20078 leader_election.cc:290] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.588065 20442 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:08.600378 20493 leader_election.cc:290] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:08.630304 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 115611us
W20260204 09:00:08.632704 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 90430.6us
I20260204 09:00:08.633330 20508 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:08.624132 18414 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:08.624393 20391 raft_consensus.cc:3060] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:08.652045 18414 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:08.652354 19100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.645437 19050 leader_election.cc:304] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:08.608510 20502 raft_consensus.cc:2749] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260204 09:00:08.617924 20371 raft_consensus.cc:2749] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260204 09:00:08.620128 20498 leader_election.cc:290] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:08.655615 18414 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 09:00:08.657809 18488 connection.cc:232] RPC call timeout handler was delayed by -1.0176400550000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260204 09:00:08.590770 20435 consensus_queue.cc:237] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:08.639624 20442 raft_consensus.cc:3060] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:08.659437 18488 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:08.664249 19102 raft_consensus.cc:1275] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260204 09:00:08.668502 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 63476.6us
I20260204 09:00:08.669826 18340 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:08.653165 20078 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:08.662940 20502 consensus_queue.cc:1048] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260204 09:00:08.654326 20294 leader_election.cc:290] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:08.657153 20456 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:08.677681 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.659684 20398 raft_consensus.cc:2804] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:08.660881 20493 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:08.674721 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.680891 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.667245 20439 leader_election.cc:290] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:08.669211 20375 leader_election.cc:290] T 22576b5cf9c246408bb6b297c9f03412 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:08.693432 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.685505 19102 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:08.679617 20425 raft_consensus.cc:2749] T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:08.703291 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.704891 19100 pending_rounds.cc:85] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Aborting all ops after (but not including) 3
I20260204 09:00:08.705240 19100 pending_rounds.cc:107] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260204 09:00:08.705468 19100 raft_consensus.cc:2889] T b0195e35f81741c9858f099628293034 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:00:08.676616 20078 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:08.682119 20398 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:08.681543 20477 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.654520 20508 raft_consensus.cc:515] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:08.683552 20493 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:08.694002 20456 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260204 09:00:08.687510 20202 leader_election.cc:290] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.712459 20510 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:08.728224 20510 raft_consensus.cc:515] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:08.730227 20510 leader_election.cc:290] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:08.716046 20078 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:08.726085 20477 raft_consensus.cc:2749] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:08.733651 19109 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 3.
I20260204 09:00:08.723524 20456 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:08.736364 20456 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:08.741881 20391 raft_consensus.cc:515] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.735826 20508 leader_election.cc:290] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:08.721091 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 50317.3us
I20260204 09:00:08.719272 20398 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:08.700754 20384 raft_consensus.cc:2749] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260204 09:00:08.722679 20493 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:08.720263 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 64717.4us
I20260204 09:00:08.733657 20479 leader_election.cc:290] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:08.719846 20497 consensus_queue.cc:1048] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
I20260204 09:00:08.529505 18368 rpcz_store.cc:276] 0204 09:00:06.773585 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.525198 (+751613us) service_pool.cc:225] Handling call
0204 09:00:07.593256 (+ 68058us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:07.604524 (+ 11268us) raft_consensus.cc:1534] Early marking committed up to index 5
0204 09:00:07.630688 (+ 26164us) log.cc:844] Serialized 14 byte log entry
0204 09:00:08.421358 (+790670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:08.426162 (+ 4804us) raft_consensus.cc:1645] Marking committed up to 5
0204 09:00:08.432593 (+ 6431us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:08.442955 (+ 10362us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:08.449441 (+ 6486us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":126353,"prepare.queue_time_us":6676,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":144059,"spinlock_wait_cycles":141958400,"thread_start_us":620133,"threads_started":1,"wal-append.queue_time_us":648377}
I20260204 09:00:08.736009 20484 raft_consensus.cc:515] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
W20260204 09:00:08.768326 20512 log.cc:927] Time spent T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260204 09:00:08.760136 20319 leader_election.cc:290] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:08.762112 20521 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260204 09:00:08.773521 18375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45722 (request call id 841) took 1866 ms (client timeout 1764 ms). Trace:
I20260204 09:00:08.775928 20510 consensus_queue.cc:1048] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 09:00:08.777048 20494 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.802843 20493 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.778728 20314 raft_consensus.cc:2749] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:08.779600 20492 leader_election.cc:290] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:08.782521 18518 raft_consensus.cc:1240] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: []
W20260204 09:00:08.783074 20457 log.cc:927] Time spent T cf58feb0b26e413a84bdd849dedcaa81 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 1.525s user 0.018s sys 0.014s
I20260204 09:00:08.785351 20496 leader_election.cc:290] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:08.788139 18372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45710 (request call id 1023) took 3339 ms (client timeout 1520 ms). Trace:
I20260204 09:00:08.793035 18524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 354) took 1760 ms. Trace:
I20260204 09:00:08.842262 18524 rpcz_store.cc:276] 0204 09:00:07.032652 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.032783 (+ 131us) service_pool.cc:225] Handling call
0204 09:00:07.047494 (+ 14711us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:08.299990 (+1252496us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:08.792783 (+492793us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400214154. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:08.792973 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2848521600}
I20260204 09:00:08.804237 18451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 776) took 2274 ms. Trace:
I20260204 09:00:08.764384 18414 leader_election.cc:304] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:08.843842 18451 rpcz_store.cc:276] 0204 09:00:06.529906 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:06.945330 (+415424us) service_pool.cc:225] Handling call
0204 09:00:07.039841 (+ 94511us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:07.577172 (+537331us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:07.577203 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:07.577245 (+ 42us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:07.577273 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:08.803990 (+1226717us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400576f54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:08.804044 (+ 54us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:08.804180 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1235293440}
I20260204 09:00:08.805050 18442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47922 (request call id 785) took 1393 ms. Trace:
W20260204 09:00:08.765545 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:08.847604 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 83315us
I20260204 09:00:08.845682 18442 rpcz_store.cc:276] 0204 09:00:07.411889 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.512904 (+101015us) service_pool.cc:225] Handling call
0204 09:00:08.804846 (+1291942us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b540016ec54. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:08.804991 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18900352}
I20260204 09:00:08.800621 20291 leader_election.cc:290] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:08.796705 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfa617c4afef4c2f958395c561a1c8b5" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:08.831241 18375 rpcz_store.cc:269] 0204 09:00:06.906880 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.092041 (+185161us) service_pool.cc:225] Handling call
0204 09:00:08.773343 (+1681302us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b54001cf054. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:08.773455 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":112969984}
I20260204 09:00:08.807161 20484 leader_election.cc:290] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 8 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:08.829958 20078 raft_consensus.cc:515] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.839445 18518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52184 (request call id 355) took 1799 ms. Trace:
I20260204 09:00:08.854272 18518 rpcz_store.cc:276] 0204 09:00:07.040641 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.040961 (+ 320us) service_pool.cc:225] Handling call
0204 09:00:08.782137 (+1741176us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3c0af0 00007fcebd3ab459 00007fcebd3aaf02 00007fceb692fd34
0204 09:00:08.782339 (+ 202us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:08.839164 (+ 56825us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:08.839367 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17992064}
I20260204 09:00:08.831717 20391 leader_election.cc:290] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
W20260204 09:00:08.841950 18372 rpcz_store.cc:269] 0204 09:00:05.449192 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.470944 (+ 21752us) service_pool.cc:225] Handling call
0204 09:00:08.787915 (+3316971us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54005cb054. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:08.788066 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3919886720}
I20260204 09:00:08.832995 20510 consensus_queue.cc:1243] T 097dd514c346448db7708716b992ea2c P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Peer 44601d9bf1ce4a70a5b01dcfc505d276 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260204 09:00:08.832616 20521 raft_consensus.cc:493] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:08.743599 20440 raft_consensus.cc:2749] T 0d40b352c1b54b1e875dc8a41b09f865 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260204 09:00:08.833377 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 165480us
I20260204 09:00:08.837414 20456 raft_consensus.cc:515] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:08.852120 20493 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.791571 20471 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.851819 20384 raft_consensus.cc:2749] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:08.853595 19099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46718 (request call id 759) took 1171 ms. Trace:
I20260204 09:00:08.798655 20377 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:08.870327 18488 leader_election.cc:304] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 09:00:08.874958 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 162222us
I20260204 09:00:08.865185 18414 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 09:00:08.876729 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 231385us
I20260204 09:00:08.881001 19099 rpcz_store.cc:276] 0204 09:00:07.681915 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:08.420031 (+738116us) service_pool.cc:225] Handling call
0204 09:00:08.420386 (+ 355us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:08.853018 (+432632us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:08.853054 (+ 36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:08.853103 (+ 49us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:08.853133 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:08.853202 (+ 69us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:08.853322 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":46897,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":237064,"threads_started":1}
I20260204 09:00:08.855906 18519 raft_consensus.cc:2468] T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
W20260204 09:00:08.883946 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 240236us
I20260204 09:00:08.851167 20442 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.913076 20494 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.914625 20471 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Requested vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:08.915685 20078 leader_election.cc:290] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.918081 20398 raft_consensus.cc:515] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:08.920990 20377 leader_election.cc:290] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Requested vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:08.921762 18519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60772 (request call id 745) took 1960 ms (client timeout 2019 ms). Trace:
I20260204 09:00:08.899374 20440 raft_consensus.cc:2749] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 09:00:08.922192 20423 consensus_queue.cc:1048] T 386fda89477c4d2e8f27ed60e5176a24 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260204 09:00:08.921120 20456 leader_election.cc:290] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 election: Requested vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
W20260204 09:00:08.922200 18519 rpcz_store.cc:269] 0204 09:00:06.961805 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.411530 (+449725us) service_pool.cc:225] Handling call
0204 09:00:08.796542 (+1385012us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b58004a1f98. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:08.921693 (+125151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24605056}
I20260204 09:00:08.930209 18491 leader_election.cc:304] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:08.921027 18343 leader_election.cc:304] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
W20260204 09:00:08.897119 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 134575us
I20260204 09:00:08.869433 20521 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:08.882627 20386 raft_consensus.cc:3055] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:08.934813 20386 raft_consensus.cc:740] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:08.935674 20386 consensus_queue.cc:260] T 5d8340499d764f8cb6e95f63db6fb29f P c61e83e5fb7445e8bce7eca695977903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:08.884208 20493 raft_consensus.cc:2804] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:08.936322 20423 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:08.906068 20506 raft_consensus.cc:3055] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:00:08.883775 18488 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:08.909102 18414 leader_election.cc:304] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 09:00:08.909626 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:08.933543 18340 leader_election.cc:304] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:08.933768 18491 leader_election.cc:304] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:08.934103 19050 leader_election.cc:304] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:08.941632 18414 leader_election.cc:304] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:08.945118 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:08.948086 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:08.948257 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 64589.7us
I20260204 09:00:08.948776 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:08.945118 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:08.951807 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:08.972062 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:08.974965 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:08.975841 18521 raft_consensus.cc:2393] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 6: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:08.976147 18414 leader_election.cc:304] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:08.976531 18340 leader_election.cc:304] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:08.976953 18525 raft_consensus.cc:1275] T 5a4f4307728d44029b19b3b03f406068 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260204 09:00:08.959165 18372 raft_consensus.cc:2368] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 7. Current term is 8.
I20260204 09:00:08.972554 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:08.978302 18517 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:08.974180 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:08.972244 18491 leader_election.cc:304] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:08.978737 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:08.984064 20398 leader_election.cc:290] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.985177 18519 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1f32c58bc4e422889e2b2739a3ca210" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:08.988874 20442 leader_election.cc:290] T 481bf2deabd7443ca092663a359e8f3e P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:08.990589 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:08.991358 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:08.992089 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:08.993976 18442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:08.943091 20491 log.cc:927] Time spent T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.639s user 0.003s sys 0.000s
I20260204 09:00:08.995671 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:08.996408 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.020409 18451 raft_consensus.cc:2468] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 09:00:09.020507 18443 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:08.937275 20481 raft_consensus.cc:2804] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:08.939616 20493 raft_consensus.cc:493] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:08.937108 20494 raft_consensus.cc:2804] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:08.996908 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:08.940290 20506 raft_consensus.cc:740] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:09.021421 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.000744 18491 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:09.001291 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.030604 18517 raft_consensus.cc:2468] T 72802a089d72492ca11d2d83ae08413c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:08.951715 20471 raft_consensus.cc:2804] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:09.002962 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:08.979321 20319 raft_consensus.cc:2749] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:00:09.003252 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.019491 18448 raft_consensus.cc:1240] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:09.011528 18450 raft_consensus.cc:2368] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4.
I20260204 09:00:09.012019 18444 raft_consensus.cc:2368] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6.
I20260204 09:00:09.012311 18442 raft_consensus.cc:2468] T e65e67a60cd24f02a3f66afc76e2b5f0 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:09.013861 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.015796 18340 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:09.022280 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.011147 18449 raft_consensus.cc:2393] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 7: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
W20260204 09:00:08.996250 20459 log.cc:927] Time spent T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 1.794s user 0.011s sys 0.015s
I20260204 09:00:09.001256 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.028347 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:09.006496 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:08.953572 20456 raft_consensus.cc:2804] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader election won for term 7
I20260204 09:00:08.954061 20391 raft_consensus.cc:2804] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 8 FOLLOWER]: Leader election won for term 8
I20260204 09:00:09.029160 18377 raft_consensus.cc:1275] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Refusing update from remote peer 354a648f08a44b98a7f93d74b0ea93ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260204 09:00:09.029907 18451 raft_consensus.cc:2468] T f9d6ad3406784527a0e5f590724f204e P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:09.032099 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.103507 18375 raft_consensus.cc:2468] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:09.103856 18525 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:09.104127 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.104789 18451 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:09.032202 18516 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:09.106842 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.110333 18517 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 09:00:09.111009 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.107769 19106 raft_consensus.cc:1275] T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260204 09:00:09.111534 18517 raft_consensus.cc:2393] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 6: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:09.112802 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:08.996559 20522 raft_consensus.cc:2749] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:09.108804 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.116503 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef72e5825eec43c3a4efa431934ec0e1" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.171818 18521 raft_consensus.cc:2376] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5. Re-sending same reply.
I20260204 09:00:09.105581 18522 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 09:00:09.172956 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.023907 20520 raft_consensus.cc:2804] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:09.010223 20484 raft_consensus.cc:2749] T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:09.009747 20479 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:09.019212 18519 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:09.012583 20329 raft_consensus.cc:493] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:09.189016 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.189707 18518 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:09.189774 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:09.118850 19050 connection.cc:232] RPC call timeout handler was delayed by -1.8466822970000294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24350000000000002s for a response
I20260204 09:00:09.174331 18450 raft_consensus.cc:1240] T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903 [term 5 LEADER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260204 09:00:09.191843 19050 connection.cc:232] RPC call timeout handler was delayed by -1.5708945039999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260204 09:00:09.192471 19050 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:09.114313 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.023728 20481 raft_consensus.cc:493] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.027335 20494 raft_consensus.cc:493] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:08.946620 20423 raft_consensus.cc:515] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:09.177039 20533 log.cc:927] Time spent T 5ae192d61eb4439abaccb503d5b40dd4 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.149s user 0.000s sys 0.000s
I20260204 09:00:09.200383 18414 leader_election.cc:304] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:09.177426 18451 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:09.175616 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:09.261943 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 61656.5us
I20260204 09:00:09.262359 18449 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 7.
I20260204 09:00:09.262965 18414 leader_election.cc:304] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:09.168591 20391 raft_consensus.cc:697] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [term 8 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:09.141093 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.029384 20493 raft_consensus.cc:3060] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:08.997198 20527 raft_consensus.cc:2804] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:09.184298 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.161304 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.277870 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.193621 18370 raft_consensus.cc:2468] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 3.
I20260204 09:00:09.192484 18375 raft_consensus.cc:1240] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 3. Current term is 4. Ops: []
W20260204 09:00:09.198064 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 182396us
I20260204 09:00:09.281459 18340 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:09.281585 20391 consensus_queue.cc:237] T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:09.282542 18340 leader_election.cc:304] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:09.198710 18373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.113991 18443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.107859 20435 raft_consensus.cc:2749] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260204 09:00:09.256623 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 64250.3us
I20260204 09:00:09.256003 20494 raft_consensus.cc:3060] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:09.284715 18443 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:09.291083 18517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.200196 18525 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:09.259413 18521 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf58feb0b26e413a84bdd849dedcaa81" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.258737 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4b1121fcea2a42bf88a9d98faffffd18" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.292201 18518 raft_consensus.cc:2376] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6. Re-sending same reply.
I20260204 09:00:09.105398 20518 raft_consensus.cc:493] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:09.115497 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e65e67a60cd24f02a3f66afc76e2b5f0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.299955 18525 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.257138 20439 raft_consensus.cc:493] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:09.107538 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.181291 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.303370 18448 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 3.
I20260204 09:00:09.180493 18523 raft_consensus.cc:2393] T 58a571d216c1493aae70dbd574c45d22 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 7: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
W20260204 09:00:09.265096 18476 heartbeater.cc:646] Failed to heartbeat to 127.15.3.254:37341 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.3.254:37341 timed out after 15.000s (SENT)
I20260204 09:00:09.175554 20456 raft_consensus.cc:697] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [term 7 LEADER]: Becoming Leader. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
I20260204 09:00:09.174665 20529 raft_consensus.cc:493] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:09.266489 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 94961.4us
I20260204 09:00:09.107713 20378 raft_consensus.cc:493] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:09.177627 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9d6ad3406784527a0e5f590724f204e" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.267236 18488 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 09:00:09.317186 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 50048.3us
I20260204 09:00:09.318094 18488 leader_election.cc:304] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:09.318306 18340 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:09.178730 20520 raft_consensus.cc:493] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.273870 18414 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:09.276763 18372 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
W20260204 09:00:09.319836 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 50436.6us
I20260204 09:00:09.198694 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.320508 18414 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:09.183442 20477 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:09.257355 20481 raft_consensus.cc:3060] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:09.332209 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82eb988aa19440f9ae575f7f9d90287d" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
I20260204 09:00:09.332871 18374 raft_consensus.cc:3060] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:09.335254 20382 leader_election.cc:290] T 6997ab65a1f44cd18707ec9e0afa05e9 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:09.291332 20530 raft_consensus.cc:2804] T b535c4ca953b4013861502cf99c90b2b P 44601d9bf1ce4a70a5b01dcfc505d276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:09.336311 18340 leader_election.cc:304] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:09.337070 20321 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:09.337528 20321 raft_consensus.cc:493] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 09:00:09.293675 19053 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:09.338265 19964 raft_consensus.cc:2749] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:09.339017 19964 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:09.339346 19964 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.339694 19964 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:09.340516 20524 consensus_queue.cc:1048] T 5a4f4307728d44029b19b3b03f406068 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260204 09:00:09.295661 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.342509 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.343526 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.344441 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.345341 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.345417 20358 leader_election.cc:290] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:09.345863 18377 raft_consensus.cc:2468] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:09.346717 18377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276"
W20260204 09:00:09.347950 20455 log.cc:927] Time spent T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 2.092s user 0.012s sys 0.018s
W20260204 09:00:09.348821 20534 log.cc:927] Time spent T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260204 09:00:09.350430 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.350656 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.351639 18368 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.319836 20378 raft_consensus.cc:515] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:09.355767 20378 leader_election.cc:290] T 10a6d690ab964c9892bfdda747cf6fc0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:09.356328 20378 consensus_queue.cc:1048] T 4b1121fcea2a42bf88a9d98faffffd18 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260204 09:00:09.358354 20535 log.cc:927] Time spent T 8b6b7e58d6c748838ef0cdff0f018574 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.362s user 0.001s sys 0.000s
I20260204 09:00:09.328027 20371 raft_consensus.cc:2804] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader election won for term 4
I20260204 09:00:09.359081 20371 raft_consensus.cc:697] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:09.359724 20440 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:09.359952 20371 consensus_queue.cc:237] T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:09.337985 18340 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:09.365046 18340 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:09.366572 18446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 774) took 2849 ms. Trace:
I20260204 09:00:09.367163 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.367887 18448 raft_consensus.cc:2468] T d25eb84b22c4469996abd8629863c279 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:09.305806 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.314291 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.367033 18446 rpcz_store.cc:276] 0204 09:00:06.517177 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:06.941791 (+424614us) service_pool.cc:225] Handling call
0204 09:00:06.942107 (+ 316us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:08.523839 (+1581732us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:08.523868 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:08.523910 (+ 42us) raft_consensus.cc:1645] Marking committed up to 5
0204 09:00:08.523938 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:09.366330 (+842392us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400293954. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:09.366386 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:09.366515 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1128,"raft.queue_time_us":1499,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6474,"spinlock_wait_cycles":3634317568}
I20260204 09:00:09.270354 20384 raft_consensus.cc:2804] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:09.321110 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.321230 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "386fda89477c4d2e8f27ed60e5176a24" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.401708 18516 raft_consensus.cc:2468] T 386fda89477c4d2e8f27ed60e5176a24 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
I20260204 09:00:09.323251 18488 leader_election.cc:304] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:09.284889 20392 raft_consensus.cc:2804] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:09.324397 19106 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:09.439257 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.439931 19106 raft_consensus.cc:2468] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:09.440804 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.441979 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.442579 19106 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 09:00:09.443329 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.277504 20527 raft_consensus.cc:493] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:09.200785 20506 consensus_queue.cc:260] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:09.326911 20520 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:09.337874 20321 raft_consensus.cc:3060] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:09.202558 20329 raft_consensus.cc:515] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:09.371049 18370 raft_consensus.cc:2468] T a43a955d03304c0b847a09e4d430afc1 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 5.
I20260204 09:00:09.381675 18374 raft_consensus.cc:2468] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:09.518947 18374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45710 (request call id 1036) took 1062 ms. Trace:
I20260204 09:00:09.519311 18374 rpcz_store.cc:276] 0204 09:00:08.456858 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:08.457031 (+ 173us) service_pool.cc:225] Handling call
0204 09:00:09.332043 (+875012us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b5800035798. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5303db1 00007fceb5303c62 00007fcebe1b6dd9 00007fcebd336260 00007fcebd3fedbb 00007fcebd3fee41 00007fcebd3acbd0 00007fcebd3ac4b4 00007fceb6934834 00007fceb69347c2
0204 09:00:09.518890 (+186847us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12659456}
I20260204 09:00:09.520714 18374 raft_consensus.cc:1240] T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Rejecting Update request from peer c61e83e5fb7445e8bce7eca695977903 for earlier term 7. Current term is 8. Ops: []
I20260204 09:00:09.189103 20471 raft_consensus.cc:697] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [term 6 LEADER]: Becoming Leader. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:09.404310 18522 raft_consensus.cc:2393] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 5: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:09.201327 20479 raft_consensus.cc:515] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:09.432535 19101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46704 (request call id 878) took 1667 ms (client timeout 1650 ms). Trace:
W20260204 09:00:09.522228 19101 rpcz_store.cc:269] 0204 09:00:07.696527 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:08.277801 (+581274us) service_pool.cc:225] Handling call
0204 09:00:09.363410 (+1085609us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400006ed4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:09.363519 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":536073088}
W20260204 09:00:09.432911 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 66988us
I20260204 09:00:09.523399 18343 leader_election.cc:304] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:09.327405 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f643d3c57ebd457682398d38173a22c8" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.524362 18518 raft_consensus.cc:3060] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 8
I20260204 09:00:09.444659 18372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.451455 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b53e40eb77df4f698c18c0d12effd872" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:09.463552 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:09.302567 18371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:09.466126 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 92826.4us
I20260204 09:00:09.536116 18340 leader_election.cc:304] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab
W20260204 09:00:09.476792 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 153616us
I20260204 09:00:09.479844 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.538494 18516 raft_consensus.cc:2393] T 22576b5cf9c246408bb6b297c9f03412 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 8: Already voted for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in this term.
I20260204 09:00:09.482441 19106 raft_consensus.cc:3060] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:09.290306 20299 consensus_queue.cc:1048] T 5d9e92ea8b0a4317bf54894cf1629480 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
W20260204 09:00:09.483698 18417 connection.cc:232] RPC call timeout handler was delayed by -1.7039744870000959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260204 09:00:09.541697 18417 connection.cc:232] RPC call timeout handler was delayed by -1.3915187200000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260204 09:00:09.483021 20524 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 09:00:09.486135 18450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.492157 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.329295 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.317808 20439 raft_consensus.cc:515] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:09.362497 20499 raft_consensus.cc:2804] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Leader election won for term 7
I20260204 09:00:09.319563 20529 raft_consensus.cc:515] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:09.504760 18444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.365294 20440 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.564136 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.384361 20496 raft_consensus.cc:2804] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260204 09:00:09.569989 18376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34972 (request call id 17) took 1101 ms. Trace:
I20260204 09:00:09.577973 18376 rpcz_store.cc:276] 0204 09:00:08.463121 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:08.510251 (+ 47130us) service_pool.cc:225] Handling call
0204 09:00:09.559874 (+1049623us) spinlock_profiling.cc:243] Waited 84.8 ms on lock 0x7b5400501ed4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83e94d3 00007fcebd3af13a 00007fceb6942934 00007fceb69428c2 00007fceb69427f1 00007fceb694276c 00007fceb6941a22 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:09.559958 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":195138432}
I20260204 09:00:09.445777 20392 raft_consensus.cc:493] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.391954 20384 raft_consensus.cc:493] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:09.301196 20495 consensus_queue.cc:1059] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.184s
W20260204 09:00:09.542037 18417 connection.cc:232] RPC call timeout handler was delayed by -1.2060306429999628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
W20260204 09:00:09.590821 18524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s user 0.001s sys 0.030s
W20260204 09:00:09.591171 18524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s user 0.001s sys 0.030s
I20260204 09:00:09.484508 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.592080 18449 raft_consensus.cc:2393] T e09db0ac6e104e1e9a0ca7ebafab0cde P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44601d9bf1ce4a70a5b01dcfc505d276 in current term 3: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:09.500310 20492 raft_consensus.cc:2804] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:09.550173 19109 raft_consensus.cc:2393] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:09.543025 20546 raft_consensus.cc:2804] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260204 09:00:09.544682 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ae192d61eb4439abaccb503d5b40dd4" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.550689 18523 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 5.
I20260204 09:00:09.550804 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:09.554153 19099 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s user 0.027s sys 0.101s
I20260204 09:00:09.493186 20527 raft_consensus.cc:3060] T cf58feb0b26e413a84bdd849dedcaa81 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:09.557291 18372 pending_rounds.cc:85] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: Aborting all ops after (but not including) 3
I20260204 09:00:09.387097 20477 raft_consensus.cc:515] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:09.557978 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a43a955d03304c0b847a09e4d430afc1" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.362651 20435 raft_consensus.cc:2804] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:09.360575 20456 consensus_queue.cc:237] T d7c5f3d791434f71a1cc75df662bd3c6 P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:09.312772 20518 raft_consensus.cc:515] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:09.575700 19106 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 7.
I20260204 09:00:09.562562 18450 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 6.
I20260204 09:00:09.529593 20377 raft_consensus.cc:2749] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:09.529429 20506 raft_consensus.cc:3060] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:09.577111 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4a90ced875b42b0be979d1dc8a5d977" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.584371 18442 pending_rounds.cc:85] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Aborting all ops after (but not including) 2
I20260204 09:00:09.655143 18442 pending_rounds.cc:107] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260204 09:00:09.655514 18442 raft_consensus.cc:2889] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:00:09.587313 18451 raft_consensus.cc:2468] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 6.
W20260204 09:00:09.588361 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 267929us
W20260204 09:00:09.594976 19099 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s user 0.027s sys 0.101s
I20260204 09:00:09.626015 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.595090 18522 raft_consensus.cc:2393] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab in current term 8: Already voted for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in this term.
I20260204 09:00:09.657445 18449 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:09.618789 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.619426 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4"
I20260204 09:00:09.655169 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.620505 18372 pending_rounds.cc:107] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260204 09:00:09.624014 20528 log.cc:927] Time spent T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260204 09:00:09.587999 20392 raft_consensus.cc:3060] T 72802a089d72492ca11d2d83ae08413c P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:09.621493 18518 raft_consensus.cc:2468] T f643d3c57ebd457682398d38173a22c8 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 8.
I20260204 09:00:09.576669 20440 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:09.628371 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d17b9b554db3494a9c6594df37a1ab2f" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.577762 20496 raft_consensus.cc:493] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:09.594094 20384 raft_consensus.cc:3060] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:09.658511 18523 raft_consensus.cc:2368] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7.
W20260204 09:00:09.680716 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 361515us
I20260204 09:00:09.658126 19101 raft_consensus.cc:3060] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:09.674664 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17155b1b19aa43f291361bcd323bf470" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.719220 18522 raft_consensus.cc:2468] T 17155b1b19aa43f291361bcd323bf470 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:09.655172 18516 raft_consensus.cc:2468] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 4.
I20260204 09:00:09.674181 18414 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:09.694882 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b58fa367186430c9ecb96a31021923c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.593616 20492 raft_consensus.cc:493] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.626569 20435 raft_consensus.cc:493] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.673189 20423 leader_election.cc:290] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:09.597731 18488 leader_election.cc:304] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:09.692004 18372 raft_consensus.cc:2889] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:00:09.619102 20546 raft_consensus.cc:493] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:09.699236 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "481bf2deabd7443ca092663a359e8f3e" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.702941 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.744227 18449 raft_consensus.cc:2468] T 5a8edc898e45413484df91b064f36114 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:09.720968 18518 raft_consensus.cc:2468] T 8b58fa367186430c9ecb96a31021923c P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 5.
I20260204 09:00:09.723282 18523 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2817d87504042fba8cda4e4e352c571" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.744751 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d25eb84b22c4469996abd8629863c279" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.717906 19050 leader_election.cc:304] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:09.675096 20524 raft_consensus.cc:697] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:09.724486 18524 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
W20260204 09:00:09.684975 20504 log.cc:927] Time spent T 6da43fe9c941486e99fb39317a812801 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
I20260204 09:00:09.725759 18522 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.739337 18516 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6da43fe9c941486e99fb39317a812801" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.627497 20471 consensus_queue.cc:237] T 481bf2deabd7443ca092663a359e8f3e P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:09.685235 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "447dfe3ea93642ff9abd0f55be77ea9b" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.673746 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0195e35f81741c9858f099628293034" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.752336 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.784529 19109 raft_consensus.cc:3060] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:09.754475 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 156806us
I20260204 09:00:09.785315 18488 leader_election.cc:304] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:09.786146 20543 raft_consensus.cc:2804] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:09.786631 20543 raft_consensus.cc:697] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:09.787449 20543 consensus_queue.cc:237] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:09.791961 20497 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:09.792662 20497 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:09.767684 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 181181us
I20260204 09:00:09.767705 19050 leader_election.cc:400] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 7. Current term is 8.
I20260204 09:00:09.794206 19050 leader_election.cc:403] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260204 09:00:09.794821 20549 raft_consensus.cc:3060] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:09.767845 19101 raft_consensus.cc:2468] T 58a571d216c1493aae70dbd574c45d22 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 7.
I20260204 09:00:09.796025 20543 raft_consensus.cc:493] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:09.796574 20543 raft_consensus.cc:515] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
I20260204 09:00:09.796901 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.797520 19101 raft_consensus.cc:3060] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 2 FOLLOWER]: Advancing to term 4
I20260204 09:00:09.798168 20519 consensus_queue.cc:1048] T 17155b1b19aa43f291361bcd323bf470 P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260204 09:00:09.798547 20543 leader_election.cc:290] T 4cf3dc838d4343bab90e123d525dfc82 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:09.725371 20492 raft_consensus.cc:3060] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:09.770125 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a934695b181f40f0a55ece7603079f63" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.775094 20442 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:09.810196 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7c5f3d791434f71a1cc75df662bd3c6" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:09.810675 19101 raft_consensus.cc:2468] T a934695b181f40f0a55ece7603079f63 P 354a648f08a44b98a7f93d74b0ea93ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 4.
I20260204 09:00:09.813374 18491 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:09.815043 18491 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:09.725703 20299 raft_consensus.cc:2804] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:09.744688 20435 raft_consensus.cc:3060] T 4b1121fcea2a42bf88a9d98faffffd18 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:00:09.775260 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72802a089d72492ca11d2d83ae08413c" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.766685 20508 raft_consensus.cc:2749] T 5a4f4307728d44029b19b3b03f406068 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260204 09:00:09.783119 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.195:40161, user_credentials={real_user=slave}} blocked reactor thread for 247062us
I20260204 09:00:09.746490 18417 leader_election.cc:304] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:09.675356 20547 raft_consensus.cc:3055] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:00:09.714704 20496 raft_consensus.cc:3060] T b535c4ca953b4013861502cf99c90b2b P 5bc1d8b58ce0457da263c5c017c92ca4 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:09.767083 20546 raft_consensus.cc:3060] T e09db0ac6e104e1e9a0ca7ebafab0cde P 44601d9bf1ce4a70a5b01dcfc505d276 [term 2 FOLLOWER]: Advancing to term 3
W20260204 09:00:09.778228 20537 log.cc:927] Time spent T ba427f707a5a42fb975b3a3ee7215aa6 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.391s user 0.001s sys 0.000s
I20260204 09:00:09.771436 20510 raft_consensus.cc:2804] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:09.800132 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a8edc898e45413484df91b064f36114" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
I20260204 09:00:09.803004 18449 raft_consensus.cc:2393] T a934695b181f40f0a55ece7603079f63 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 4: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
W20260204 09:00:09.770761 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 96643.9us
W20260204 09:00:09.803887 18490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:09.805714 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.815876 18491 leader_election.cc:304] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 09:00:09.881374 18491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 65566.4us
I20260204 09:00:09.881529 19106 raft_consensus.cc:2468] T 097dd514c346448db7708716b992ea2c P 354a648f08a44b98a7f93d74b0ea93ab [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44601d9bf1ce4a70a5b01dcfc505d276 in term 9.
I20260204 09:00:09.811549 19101 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.817373 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a76dccca152648179027ee96bc473ad7" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.882217 18491 leader_election.cc:304] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:09.816910 18448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a0fe8603cb44c8879dce83514090c0" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:09.808626 20078 raft_consensus.cc:2804] T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:09.882793 19102 raft_consensus.cc:2393] T 5a8edc898e45413484df91b064f36114 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c61e83e5fb7445e8bce7eca695977903 in current term 5: Already voted for candidate 354a648f08a44b98a7f93d74b0ea93ab in this term.
I20260204 09:00:09.871227 18375 raft_consensus.cc:1275] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Refusing update from remote peer 5bc1d8b58ce0457da263c5c017c92ca4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 09:00:09.871241 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b2ad7461fbe43dea33bdbb755e246c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:09.809059 20442 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.818370 20495 raft_consensus.cc:493] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:09.815703 20319 raft_consensus.cc:493] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44601d9bf1ce4a70a5b01dcfc505d276)
I20260204 09:00:09.871484 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4cf3dc838d4343bab90e123d525dfc82" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
W20260204 09:00:09.868546 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 122060us
I20260204 09:00:09.800634 20499 raft_consensus.cc:697] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 LEADER]: Becoming Leader. State: Replica: 44601d9bf1ce4a70a5b01dcfc505d276, State: Running, Role: LEADER
I20260204 09:00:09.883873 19101 raft_consensus.cc:2468] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 3.
I20260204 09:00:09.892009 18417 leader_election.cc:304] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:09.819470 20543 raft_consensus.cc:2749] T f4a90ced875b42b0be979d1dc8a5d977 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:09.884907 18374 raft_consensus.cc:2468] T 1b2ad7461fbe43dea33bdbb755e246c9 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
I20260204 09:00:09.885124 18518 raft_consensus.cc:1240] T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6. Ops: []
W20260204 09:00:09.821787 20539 log.cc:927] Time spent T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.266s user 0.001s sys 0.000s
I20260204 09:00:09.819312 20299 raft_consensus.cc:493] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:09.906996 20299 raft_consensus.cc:3060] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:09.907171 18518 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "097dd514c346448db7708716b992ea2c" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" is_pre_election: true
I20260204 09:00:09.910516 18518 raft_consensus.cc:1275] T 64ea22ea98194ddba012eb97da4ef833 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Refusing update from remote peer 44601d9bf1ce4a70a5b01dcfc505d276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260204 09:00:09.826509 20511 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:09.887923 19109 raft_consensus.cc:2468] T 447dfe3ea93642ff9abd0f55be77ea9b P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
I20260204 09:00:09.872376 20497 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:09.891080 18370 raft_consensus.cc:2468] T 4cf3dc838d4343bab90e123d525dfc82 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 6.
I20260204 09:00:09.882303 18414 leader_election.cc:304] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
W20260204 09:00:09.893352 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 67624.2us
W20260204 09:00:09.876101 19964 consensus_meta.cc:287] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.536s user 0.009s sys 0.000s
I20260204 09:00:09.895967 20319 raft_consensus.cc:515] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:09.896808 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2386346b21154761adcf3b5b27f8e2dc" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 09:00:09.871397 20552 log.cc:927] Time spent T cfa617c4afef4c2f958395c561a1c8b5 P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
W20260204 09:00:09.901461 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 105720us
I20260204 09:00:09.857050 19099 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e09db0ac6e104e1e9a0ca7ebafab0cde"
dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab"
mode: GRACEFUL
new_leader_uuid: "c61e83e5fb7445e8bce7eca695977903"
from {username='slave'} at 127.0.0.1:41020
I20260204 09:00:09.822788 20329 leader_election.cc:290] T 93c6901415594017879443427a92d4c9 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:09.853582 20439 leader_election.cc:290] T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:09.868261 20358 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:09.913024 19101 raft_consensus.cc:1240] T 0d40b352c1b54b1e875dc8a41b09f865 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Rejecting Update request from peer 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 6. Current term is 7. Ops: []
I20260204 09:00:09.905205 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6997ab65a1f44cd18707ec9e0afa05e9" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:09.864902 20547 raft_consensus.cc:740] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 354a648f08a44b98a7f93d74b0ea93ab, State: Running, Role: LEADER
I20260204 09:00:09.890097 19106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4f47e43eb8c44a19193f49d4f8d66ec" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.888370 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b84b4beaf8a4f0ba8732c09d4230b3b" candidate_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:09.890664 20442 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:09.866384 20550 raft_consensus.cc:2749] T ef72e5825eec43c3a4efa431934ec0e1 P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260204 09:00:09.935221 19109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.935508 19102 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f93610353fcc43beabd7d2cf48df6a80" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:09.937959 18488 leader_election.cc:304] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:09.885703 20321 raft_consensus.cc:515] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:09.903584 20398 raft_consensus.cc:2749] T 10a6d690ab964c9892bfdda747cf6fc0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260204 09:00:09.941059 20544 log.cc:927] Time spent T 6997ab65a1f44cd18707ec9e0afa05e9 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260204 09:00:09.943962 20570 consensus_queue.cc:1048] T 05f065f08b15420e8394a3226291d518 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260204 09:00:09.945087 20554 log.cc:927] Time spent T b0195e35f81741c9858f099628293034 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260204 09:00:09.952739 19108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 897) took 1015 ms. Trace:
I20260204 09:00:09.912293 20477 leader_election.cc:290] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:09.939890 20518 leader_election.cc:290] T 79332110ca7d46dd8fb7875471d3242d P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:09.947461 20543 raft_consensus.cc:2749] T b0195e35f81741c9858f099628293034 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:09.915324 20571 raft_consensus.cc:2804] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Leader election won for term 7
W20260204 09:00:09.957377 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 60533.7us
I20260204 09:00:09.881260 20510 raft_consensus.cc:493] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:09.901185 20495 raft_consensus.cc:515] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:09.959497 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 77256.3us
W20260204 09:00:09.960031 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:10.084371 18414 leader_election.cc:304] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bc1d8b58ce0457da263c5c017c92ca4, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:10.084615 18340 leader_election.cc:304] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:09.950142 20529 leader_election.cc:290] T 4e191332a2aa4570928931434e061abb P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
W20260204 09:00:09.982339 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:10.011461 19099 raft_consensus.cc:606] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Received request to transfer leadership to TS c61e83e5fb7445e8bce7eca695977903
I20260204 09:00:10.085425 19099 raft_consensus.cc:614] T e09db0ac6e104e1e9a0ca7ebafab0cde P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260204 09:00:10.011724 18343 leader_election.cc:304] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276; no voters:
I20260204 09:00:09.865980 20524 consensus_queue.cc:237] T 5a6bc13bd9a04185a8b1ad985fb86531 P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } }
W20260204 09:00:09.997879 20498 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.297s user 0.009s sys 0.031s
I20260204 09:00:10.018735 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b535c4ca953b4013861502cf99c90b2b" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:10.088016 18448 raft_consensus.cc:2368] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for earlier term 6. Current term is 7.
I20260204 09:00:10.020252 19106 raft_consensus.cc:2468] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 5.
I20260204 09:00:10.064636 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58a571d216c1493aae70dbd574c45d22" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
W20260204 09:00:10.026386 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:10.013674 20508 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:10.021021 18446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a6bc13bd9a04185a8b1ad985fb86531" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:10.089381 18449 raft_consensus.cc:2393] T 58a571d216c1493aae70dbd574c45d22 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 7: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
W20260204 09:00:10.077487 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 174090us
I20260204 09:00:10.076329 19108 rpcz_store.cc:276] 0204 09:00:08.937356 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:08.938339 (+ 983us) service_pool.cc:225] Handling call
0204 09:00:08.938717 (+ 378us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:08.938938 (+ 221us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:08.938963 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:08.945577 (+ 6614us) log.cc:844] Serialized 26 byte log entry
0204 09:00:09.108501 (+162924us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:09.108539 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:09.108598 (+ 59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:09.952504 (+843906us) raft_consensus.cc:1685] finished
0204 09:00:09.952527 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:09.952677 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":122292,"threads_started":1,"wal-append.queue_time_us":289138}
I20260204 09:00:10.016022 20566 raft_consensus.cc:2804] T 447dfe3ea93642ff9abd0f55be77ea9b P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:00:10.019529 20573 raft_consensus.cc:493] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:10.085632 18340 leader_election.cc:304] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 354a648f08a44b98a7f93d74b0ea93ab
I20260204 09:00:10.010417 19964 raft_consensus.cc:515] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:10.091254 18491 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 09:00:10.096091 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 130680us
I20260204 09:00:10.098316 18417 leader_election.cc:304] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:09.959738 20499 consensus_queue.cc:237] T 5ccfea57ae48454abf38341aee79315f P 44601d9bf1ce4a70a5b01dcfc505d276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:10.099364 18375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79332110ca7d46dd8fb7875471d3242d" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:10.092242 18414 leader_election.cc:304] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
I20260204 09:00:10.099442 18417 leader_election.cc:304] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:10.084450 20510 raft_consensus.cc:3060] T 5a6bc13bd9a04185a8b1ad985fb86531 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:10.091485 20498 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.398s user 0.009s sys 0.032s
I20260204 09:00:10.091276 20550 raft_consensus.cc:2804] T f643d3c57ebd457682398d38173a22c8 P c61e83e5fb7445e8bce7eca695977903 [term 8 FOLLOWER]: Leader election won for term 8
I20260204 09:00:10.102521 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05f065f08b15420e8394a3226291d518" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:10.102756 18374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba427f707a5a42fb975b3a3ee7215aa6" candidate_uuid: "c61e83e5fb7445e8bce7eca695977903" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:10.115438 18370 raft_consensus.cc:2468] T 05f065f08b15420e8394a3226291d518 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c61e83e5fb7445e8bce7eca695977903 in term 6.
W20260204 09:00:10.111080 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 98335.8us
I20260204 09:00:10.101512 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53c3327666de4ae08e91d63cc5af2259" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:10.117194 18447 raft_consensus.cc:2468] T 53c3327666de4ae08e91d63cc5af2259 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 4.
W20260204 09:00:10.093302 20481 consensus_meta.cc:287] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 0.761s user 0.005s sys 0.010s
I20260204 09:00:10.090041 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b5fa3c805c64abf9a473724f41a0f29" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:10.118304 18449 raft_consensus.cc:2393] T 2b5fa3c805c64abf9a473724f41a0f29 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 in current term 6: Already voted for candidate c61e83e5fb7445e8bce7eca695977903 in this term.
I20260204 09:00:10.110258 18414 leader_election.cc:304] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:10.088070 20571 raft_consensus.cc:697] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:10.124003 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
W20260204 09:00:10.122200 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:10.124902 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:10.125219 19050 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:10.100131 20561 raft_consensus.cc:2804] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260204 09:00:10.097891 20543 raft_consensus.cc:2804] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:10.100051 20563 raft_consensus.cc:2804] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:10.110419 20398 raft_consensus.cc:2749] T b53e40eb77df4f698c18c0d12effd872 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260204 09:00:10.129619 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:10.096364 20573 raft_consensus.cc:515] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:10.092954 20508 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:10.137904 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10a6d690ab964c9892bfdda747cf6fc0" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:10.139911 18447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22576b5cf9c246408bb6b297c9f03412" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:10.098686 20529 consensus_queue.cc:1059] T 3b84b4beaf8a4f0ba8732c09d4230b3b P 354a648f08a44b98a7f93d74b0ea93ab [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260204 09:00:10.148811 18447 raft_consensus.cc:3060] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:00:10.143270 18374 raft_consensus.cc:1240] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260204 09:00:10.136823 18375 raft_consensus.cc:1240] T 82eb988aa19440f9ae575f7f9d90287d P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Rejecting Update request from peer 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6. Ops: []
I20260204 09:00:10.144614 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d8340499d764f8cb6e95f63db6fb29f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903" is_pre_election: true
I20260204 09:00:10.151369 19107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46718 (request call id 758) took 2469 ms. Trace:
I20260204 09:00:10.153352 19107 rpcz_store.cc:276] 0204 09:00:07.681762 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:08.375960 (+694198us) service_pool.cc:225] Handling call
0204 09:00:08.421693 (+ 45733us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:08.466268 (+ 44575us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:08.466300 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:08.466342 (+ 42us) raft_consensus.cc:1645] Marking committed up to 5
0204 09:00:08.466370 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:10.151139 (+1684769us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b5400005ad4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:10.151192 (+ 53us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:10.151312 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":102089088}
W20260204 09:00:10.139930 20505 log.cc:927] Time spent T 64ea22ea98194ddba012eb97da4ef833 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 1.531s user 0.003s sys 0.007s
I20260204 09:00:10.155601 18449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93c6901415594017879443427a92d4c9" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c61e83e5fb7445e8bce7eca695977903"
I20260204 09:00:10.161016 20477 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:10.134707 20570 raft_consensus.cc:2804] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:10.166973 19107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d9e92ea8b0a4317bf54894cf1629480" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
W20260204 09:00:10.165665 18414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 55469.6us
I20260204 09:00:10.134946 20543 raft_consensus.cc:493] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:10.139670 20563 raft_consensus.cc:493] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:10.174067 18370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e191332a2aa4570928931434e061abb" candidate_uuid: "354a648f08a44b98a7f93d74b0ea93ab" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" is_pre_election: true
I20260204 09:00:10.184253 18370 raft_consensus.cc:2468] T 4e191332a2aa4570928931434e061abb P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 354a648f08a44b98a7f93d74b0ea93ab in term 8.
I20260204 09:00:10.184120 19102 raft_consensus.cc:2410] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bc1d8b58ce0457da263c5c017c92ca4 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260204 09:00:10.150619 20507 log.cc:927] Time spent T 263a60191abd44948307685e71fc6321 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 1.531s user 0.000s sys 0.013s
I20260204 09:00:10.136089 20561 raft_consensus.cc:493] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:10.144273 20518 raft_consensus.cc:2749] T 6da43fe9c941486e99fb39317a812801 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260204 09:00:10.150647 20549 raft_consensus.cc:2749] T 2386346b21154761adcf3b5b27f8e2dc P 354a648f08a44b98a7f93d74b0ea93ab [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883) with higher term. Message: Invalid argument: T 2386346b21154761adcf3b5b27f8e2dc P 44601d9bf1ce4a70a5b01dcfc505d276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 7. Current term is 8.
I20260204 09:00:10.165980 20556 raft_consensus.cc:2804] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260204 09:00:10.155556 20398 raft_consensus.cc:2804] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260204 09:00:10.127022 20481 raft_consensus.cc:515] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:10.083565 20547 consensus_queue.cc:260] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
W20260204 09:00:10.191221 20572 log.cc:927] Time spent T 82eb988aa19440f9ae575f7f9d90287d P 5bc1d8b58ce0457da263c5c017c92ca4: Append to log took a long time: real 0.218s user 0.000s sys 0.001s
I20260204 09:00:10.170251 20577 raft_consensus.cc:2749] T 5ae192d61eb4439abaccb503d5b40dd4 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260204 09:00:10.175613 20570 raft_consensus.cc:493] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:00:10.183041 20543 raft_consensus.cc:3060] T 1b2ad7461fbe43dea33bdbb755e246c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:00:10.237159 20398 raft_consensus.cc:493] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:10.309935 20398 raft_consensus.cc:3060] T a43a955d03304c0b847a09e4d430afc1 P c61e83e5fb7445e8bce7eca695977903 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:10.225476 20319 leader_election.cc:290] T 5d9e92ea8b0a4317bf54894cf1629480 P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
I20260204 09:00:10.372416 18373 raft_consensus.cc:2368] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 354a648f08a44b98a7f93d74b0ea93ab for earlier term 5. Current term is 6.
I20260204 09:00:10.189757 20563 raft_consensus.cc:3060] T 17155b1b19aa43f291361bcd323bf470 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:00:10.236691 20556 raft_consensus.cc:493] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:10.183723 20439 consensus_queue.cc:1059] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260204 09:00:10.184083 20477 raft_consensus.cc:515] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } }
I20260204 09:00:11.004494 18414 leader_election.cc:304] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276, c61e83e5fb7445e8bce7eca695977903; no voters:
I20260204 09:00:10.639487 19104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46704 (request call id 885) took 2138 ms. Trace:
W20260204 09:00:10.948544 19050 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s user 0.007s sys 0.034s
W20260204 09:00:11.021086 19050 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s user 0.009s sys 0.036s
W20260204 09:00:10.979743 18417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s user 0.001s sys 0.009s
W20260204 09:00:11.028045 18417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s user 0.001s sys 0.009s
W20260204 09:00:11.028759 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 929337us
I20260204 09:00:11.030573 18417 leader_election.cc:304] T d17b9b554db3494a9c6594df37a1ab2f P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c61e83e5fb7445e8bce7eca695977903; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 44601d9bf1ce4a70a5b01dcfc505d276
I20260204 09:00:10.231947 20561 raft_consensus.cc:3060] T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276 [term 9 FOLLOWER]: Advancing to term 10
W20260204 09:00:10.980005 18490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.920s user 0.006s sys 0.004s
W20260204 09:00:10.622704 18416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:11.042094 18490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s user 0.007s sys 0.004s
W20260204 09:00:11.022078 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260204 09:00:11.043910 19052 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:11.017661 20547 raft_consensus.cc:3060] T c1f32c58bc4e422889e2b2739a3ca210 P 354a648f08a44b98a7f93d74b0ea93ab [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:00:11.020325 19104 rpcz_store.cc:276] 0204 09:00:08.501580 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:08.501725 (+ 145us) service_pool.cc:225] Handling call
0204 09:00:08.513267 (+ 11542us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:08.513488 (+ 221us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:08.513511 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:08.517603 (+ 4092us) log.cc:844] Serialized 26 byte log entry
0204 09:00:08.589417 (+ 71814us) raft_consensus.cc:1645] Marking committed up to 2
0204 09:00:08.589452 (+ 35us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:08.589517 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:10.042258 (+1452741us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b440002304c. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb51818b1 00007fceb5250005 00007fceb5250a22 00007fceb7f9a57b 00007fceb7f95e4f 00007fceb7f89c0e 00007fceb7f88f56 00007fceb7f88b78 00007fceb7f925c1 00007fceb7f92579 00007fceb7f92509
0204 09:00:10.576261 (+534003us) raft_consensus.cc:1685] finished
0204 09:00:10.576289 (+ 28us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:10.639381 (+ 63092us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17685760,"thread_start_us":71450,"threads_started":1,"wal-append.queue_time_us":91246}
W20260204 09:00:11.047335 18447 consensus_meta.cc:287] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 0.898s user 0.000s sys 0.014s
W20260204 09:00:10.434478 20574 log.cc:927] Time spent T 4e191332a2aa4570928931434e061abb P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.418s user 0.000s sys 0.000s
W20260204 09:00:11.011255 20575 log.cc:927] Time spent T 53c3327666de4ae08e91d63cc5af2259 P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.921s user 0.000s sys 0.001s
W20260204 09:00:10.935875 20567 log.cc:927] Time spent T 79332110ca7d46dd8fb7875471d3242d P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.915s user 0.001s sys 0.000s
W20260204 09:00:10.311233 20569 log.cc:927] Time spent T 097dd514c346448db7708716b992ea2c P 44601d9bf1ce4a70a5b01dcfc505d276: Append to log took a long time: real 0.357s user 0.000s sys 0.001s
I20260204 09:00:11.056707 18447 raft_consensus.cc:2468] T 22576b5cf9c246408bb6b297c9f03412 P c61e83e5fb7445e8bce7eca695977903 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bc1d8b58ce0457da263c5c017c92ca4 in term 8.
I20260204 09:00:11.068444 18447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47928 (request call id 1043) took 1413 ms. Trace:
I20260204 09:00:11.068895 18447 rpcz_store.cc:276] 0204 09:00:09.655566 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:10.127204 (+471638us) service_pool.cc:225] Handling call
0204 09:00:11.068380 (+941176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260204 09:00:11.050680 18445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39114 (request call id 419) took 5955 ms. Trace:
I20260204 09:00:11.061108 19050 leader_election.cc:304] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
I20260204 09:00:10.308406 20570 raft_consensus.cc:3060] T f4f47e43eb8c44a19193f49d4f8d66ec P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Advancing to term 6
W20260204 09:00:11.064594 19105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46704 (request call id 872) took 3451 ms (client timeout 1785 ms). Trace:
I20260204 09:00:11.071051 19050 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab; no voters: 44601d9bf1ce4a70a5b01dcfc505d276, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 09:00:11.071285 19105 rpcz_store.cc:269] 0204 09:00:07.613519 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:07.614751 (+ 1232us) service_pool.cc:225] Handling call
0204 09:00:11.064333 (+3449582us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540000bed4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83f2f7a 00007fcebd3ac647 00007fceb6934834 00007fceb69347c2 00007fceb69346f1 00007fceb693466c 00007fceb6933922 00007fceb672e34c 00007fceb672d786 00007fceb672d12f
0204 09:00:11.064510 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2059848448}
I20260204 09:00:10.460629 20495 leader_election.cc:290] T 64ea22ea98194ddba012eb97da4ef833 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 09:00:11.046629 20586 log.cc:927] Time spent T 5d9e92ea8b0a4317bf54894cf1629480 P 354a648f08a44b98a7f93d74b0ea93ab: Append to log took a long time: real 0.435s user 0.001s sys 0.000s
W20260204 09:00:10.575158 20565 log.cc:927] Time spent T ba427f707a5a42fb975b3a3ee7215aa6 P c61e83e5fb7445e8bce7eca695977903: Append to log took a long time: real 0.622s user 0.002s sys 0.000s
W20260204 09:00:11.064673 18449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s user 0.006s sys 0.004s
I20260204 09:00:10.559003 20497 raft_consensus.cc:493] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:00:10.921407 20585 raft_consensus.cc:493] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bc1d8b58ce0457da263c5c017c92ca4)
I20260204 09:00:11.072798 18445 rpcz_store.cc:276] 0204 09:00:05.069776 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:05.830355 (+760579us) service_pool.cc:225] Handling call
0204 09:00:05.830613 (+ 258us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:07.525230 (+1694617us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:11.024898 (+3499668us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54005b81d4. stack: 00007fceb530f373 00007fceb530f270 00007fceb4c61574 00007fcebe9256b4 00007fcebe925649 00007fceb83585a1 00007fceb83efa81 00007fceb83ee4be 00007fcebd3aaf49 00007fceb692fd34 00007fceb692fcc2 00007fceb692fbf1 00007fceb692fb6c 00007fceb692ee22 00007fceb672e34c 00007fceb672d786
0204 09:00:11.025086 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2915341184}
W20260204 09:00:11.069283 20471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.917s user 0.019s sys 0.033s
I20260204 09:00:10.643832 19964 leader_election.cc:290] T 4b1121fcea2a42bf88a9d98faffffd18 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 7 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:10.371511 20321 leader_election.cc:290] T e2a0fe8603cb44c8879dce83514090c0 P c61e83e5fb7445e8bce7eca695977903 [CANDIDATE]: Term 7 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:10.559129 20577 raft_consensus.cc:493] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 354a648f08a44b98a7f93d74b0ea93ab)
I20260204 09:00:11.025599 20556 raft_consensus.cc:3060] T f4a90ced875b42b0be979d1dc8a5d977 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 4 FOLLOWER]: Advancing to term 5
W20260204 09:00:11.077884 20358 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.004s user 0.006s sys 0.007s
I20260204 09:00:11.078236 20593 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:11.095584 20471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s user 0.019s sys 0.033s
I20260204 09:00:11.081945 20573 leader_election.cc:290] T f93610353fcc43beabd7d2cf48df6a80 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161), 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765)
I20260204 09:00:11.080504 20592 raft_consensus.cc:3055] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 7 LEADER]: Stepping down as leader of term 7
W20260204 09:00:11.065227 20492 consensus_meta.cc:287] T 53c3327666de4ae08e91d63cc5af2259 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.263s user 0.009s sys 0.024s
I20260204 09:00:11.081697 19050 leader_election.cc:304] T 386fda89477c4d2e8f27ed60e5176a24 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters: 44601d9bf1ce4a70a5b01dcfc505d276
W20260204 09:00:11.072021 18343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.972s user 0.004s sys 0.009s
I20260204 09:00:11.112248 19099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46720 (request call id 909) took 1398 ms. Trace:
W20260204 09:00:11.075488 18449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s user 0.007s sys 0.004s
I20260204 09:00:11.070590 20439 raft_consensus.cc:2804] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260204 09:00:11.073005 20508 leader_election.cc:290] T 56f846ea1dc8409290d5635d9ec149d0 P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883), c61e83e5fb7445e8bce7eca695977903 (127.15.3.195:40161)
I20260204 09:00:11.076802 20549 raft_consensus.cc:493] T 8b6b7e58d6c748838ef0cdff0f018574 P 354a648f08a44b98a7f93d74b0ea93ab [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:11.103927 20529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s user 0.001s sys 0.015s
W20260204 09:00:11.087723 20550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.931s user 0.005s sys 0.009s
W20260204 09:00:11.106400 18488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.033s user 0.011s sys 0.006s
I20260204 09:00:11.089076 20304 raft_consensus.cc:493] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c61e83e5fb7445e8bce7eca695977903)
I20260204 09:00:11.088584 20481 leader_election.cc:290] T 8b58fa367186430c9ecb96a31021923c P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 election: Requested vote from peers 5bc1d8b58ce0457da263c5c017c92ca4 (127.15.3.196:33765), 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867)
I20260204 09:00:11.078892 20477 leader_election.cc:290] T 5ccfea57ae48454abf38341aee79315f P 5bc1d8b58ce0457da263c5c017c92ca4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 354a648f08a44b98a7f93d74b0ea93ab (127.15.3.193:33867), 44601d9bf1ce4a70a5b01dcfc505d276 (127.15.3.194:43883)
W20260204 09:00:11.108408 18518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s user 0.016s sys 0.001s
W20260204 09:00:11.112934 18343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s user 0.004s sys 0.009s
W20260204 09:00:11.103729 20358 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s user 0.006s sys 0.008s
I20260204 09:00:11.114319 18449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 795) took 1625 ms. Trace:
I20260204 09:00:11.112664 19099 rpcz_store.cc:276] 0204 09:00:09.713603 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:10.100755 (+387152us) service_pool.cc:225] Handling call
0204 09:00:10.118362 (+ 17607us) raft_consensus.cc:1471] Updating replica for 1 ops
0204 09:00:10.118713 (+ 351us) raft_consensus.cc:1534] Early marking committed up to index 0
0204 09:00:10.118739 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0204 09:00:10.119179 (+ 440us) log.cc:844] Serialized 26 byte log entry
0204 09:00:10.163119 (+ 43940us) raft_consensus.cc:1645] Marking committed up to 4
0204 09:00:10.163160 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:10.163225 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0204 09:00:11.112009 (+948784us) raft_consensus.cc:1685] finished
0204 09:00:11.112031 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:11.112191 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":902941,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":122,"thread_start_us":15736,"threads_started":1,"wal-append.queue_time_us":101085}
W20260204 09:00:11.127166 18491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s user 0.017s sys 0.029s
W20260204 09:00:11.127751 19050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 46144.2us
I20260204 09:00:10.373482 20571 consensus_queue.cc:237] T 93c6901415594017879443427a92d4c9 P 5bc1d8b58ce0457da263c5c017c92ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
I20260204 09:00:11.119768 20439 raft_consensus.cc:493] T 05f065f08b15420e8394a3226291d518 P c61e83e5fb7445e8bce7eca695977903 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260204 09:00:11.140331 18343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 1.04286e+06us
W20260204 09:00:11.140995 18518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s user 0.016s sys 0.001s
I20260204 09:00:11.093097 20497 raft_consensus.cc:515] T 481bf2deabd7443ca092663a359e8f3e P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:11.122376 20529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s user 0.001s sys 0.015s
W20260204 09:00:11.142968 18491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s user 0.018s sys 0.030s
W20260204 09:00:11.163736 18491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260204 09:00:11.109846 20592 raft_consensus.cc:740] T 2386346b21154761adcf3b5b27f8e2dc P c61e83e5fb7445e8bce7eca695977903 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c61e83e5fb7445e8bce7eca695977903, State: Running, Role: LEADER
W20260204 09:00:11.132313 18340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.035s user 0.012s sys 0.008s
W20260204 09:00:11.174983 18340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.078s user 0.012s sys 0.008s
W20260204 09:00:11.175801 18340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.196:33765, user_credentials={real_user=slave}} blocked reactor thread for 1.09001e+06us
I20260204 09:00:11.177124 18340 leader_election.cc:304] T c2817d87504042fba8cda4e4e352c571 P 44601d9bf1ce4a70a5b01dcfc505d276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44601d9bf1ce4a70a5b01dcfc505d276; no voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4
W20260204 09:00:11.122622 18488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.050s user 0.011s sys 0.006s
I20260204 09:00:11.142771 18449 rpcz_store.cc:276] 0204 09:00:09.488722 (+ 0us) service_pool.cc:168] Inserting onto call queue
0204 09:00:10.182321 (+693599us) service_pool.cc:225] Handling call
0204 09:00:10.182674 (+ 353us) raft_consensus.cc:1471] Updating replica for 0 ops
0204 09:00:10.182888 (+ 214us) raft_consensus.cc:1534] Early marking committed up to index 3
0204 09:00:10.228995 (+ 46107us) log.cc:844] Serialized 14 byte log entry
0204 09:00:11.113960 (+884965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0204 09:00:11.114016 (+ 56us) raft_consensus.cc:1645] Marking committed up to 3
0204 09:00:11.114059 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0204 09:00:11.114130 (+ 71us) raft_consensus.cc:1691] UpdateReplicas() finished
0204 09:00:11.114261 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":46593,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":3337,"thread_start_us":884590,"threads_started":1,"wal-append.queue_time_us":901356}
I20260204 09:00:11.094466 20585 raft_consensus.cc:515] T 263a60191abd44948307685e71fc6321 P c61e83e5fb7445e8bce7eca695977903 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } } peers { permanent_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" member_type: VOTER last_known_addr { host: "127.15.3.196" port: 33765 } } peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } }
W20260204 09:00:11.151424 20299 consensus_meta.cc:287] T d25eb84b22c4469996abd8629863c279 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 1.241s user 0.007s sys 0.014s
I20260204 09:00:11.150063 18372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45710 (request call id 1048) took 1610 ms. Trace:
W20260204 09:00:11.148670 20493 consensus_meta.cc:287] T 5d8340499d764f8cb6e95f63db6fb29f P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.856s user 0.012s sys 0.003s
W20260204 09:00:11.144218 18519 consensus_meta.cc:287] T c1f32c58bc4e422889e2b2739a3ca210 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.887s user 0.016s sys 0.000s
W20260204 09:00:11.122417 20550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s user 0.005s sys 0.009s
I20260204 09:00:11.178984 18449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47922 (request call id 800) took 1670 ms. Trace:
I20260204 09:00:11.140532 20508 raft_consensus.cc:2804] T e2a0fe8603cb44c8879dce83514090c0 P 354a648f08a44b98a7f93d74b0ea93ab [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260204 09:00:11.152516 20384 consensus_meta.cc:287] T cfa617c4afef4c2f958395c561a1c8b5 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 1.402s user 0.014s sys 0.009s
W20260204 09:00:11.152617 20521 consensus_meta.cc:287] T f643d3c57ebd457682398d38173a22c8 P 44601d9bf1ce4a70a5b01dcfc505d276: Time spent flushing consensus metadata: real 2.204s user 0.007s sys 0.009s
I20260204 09:00:11.144265 19050 leader_election.cc:304] T f4f47e43eb8c44a19193f49d4f8d66ec P 354a648f08a44b98a7f93d74b0ea93ab [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 354a648f08a44b98a7f93d74b0ea93ab, 5bc1d8b58ce0457da263c5c017c92ca4; no voters:
W20260204 09:00:11.180205 18488 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.194:43883, user_credentials={real_user=slave}} blocked reactor thread for 1.24225e+06us
I20260204 09:00:11.196200 19099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ccfea57ae48454abf38341aee79315f" candidate_uuid: "5bc1d8b58ce0457da263c5c017c92ca4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "354a648f08a44b98a7f93d74b0ea93ab" is_pre_election: true
I20260204 09:00:11.127390 20573 raft_consensus.cc:493] T 5ccfea57ae48454abf38341aee79315f P 354a648f08a44b98a7f93d74b0ea93ab [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260204 09:00:11.152175 20520 consensus_meta.cc:287] T a934695b181f40f0a55ece7603079f63 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.622s user 0.002s sys 0.017s
W20260204 09:00:11.151221 20440 consensus_meta.cc:287] T 5a6bc13bd9a04185a8b1ad985fb86531 P c61e83e5fb7445e8bce7eca695977903: Time spent flushing consensus metadata: real 1.429s user 0.014s sys 0.000s
W20260204 09:00:11.159379 20494 consensus_meta.cc:287] T 5a8edc898e45413484df91b064f36114 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.841s user 0.008s sys 0.007s
W20260204 09:00:11.190773 18417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.3.193:33867, user_credentials={real_user=slave}} blocked reactor thread for 160224us
W20260204 09:00:11.161535 20506 consensus_meta.cc:287] T 0d40b352c1b54b1e875dc8a41b09f865 P 5bc1d8b58ce0457da263c5c017c92ca4: Time spent flushing consensus metadata: real 1.486s user 0.006s sys 0.012s
I20260204 09:00:11.192802 19105 raft_consensus.cc:3055] T 82eb988aa19440f9ae575f7f9d90287d P 354a648f08a44b98a7f93d74b0ea93ab [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:00:11.142586 20358 raft_consensus.cc:697] T e2a0fe8603cb44c8879dce83514090c0 P 5bc1d8b58ce0457da263c5c017c92ca4 [term 6 LEADER]: Becoming Leader. State: Replica: 5bc1d8b58ce0457da263c5c017c92ca4, State: Running, Role: LEADER
I20260204 09:00:11.148507 20304 raft_consensus.cc:515] T 56f846ea1dc8409290d5635d9ec149d0 P 44601d9bf1ce4a70a5b01dcfc505d276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195" port: 40161 } }
I20260204 09:00:11.103216 20577 raft_consensus.cc:515] T 3b84b4beaf8a4f0ba8732c09d4230b3b P c61e83e5fb7445e8bce7eca695977903 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "354a648f08a44b98a7f93d74b0ea93ab" member_type: VOTER last_known_addr { host: "127.15.3.193" port: 33867 } } peers { permanent_uuid: "44601d9bf1ce4a70a5b01dcfc505d276" member_type: VOTER last_known_addr { host: "127.15.3.194" port: 43883 } } peers { permanent_uuid: "c61e83e5fb7445e8bce7eca695977903" member_type: VOTER last_known_addr { host: "127.15.3.195"